Problem Statement

Implement linear regression from scratch using gradient descent. Plot with different

learning rates and plot the cost function to show convergence.

Rubric for Implementing Linear Regression Using Gradient Descent

Criteria:

$$ Implementation of Gradient Descent $(6$ Points$)$:

$>$ Correctly initializes parameters.

$>$ Accurately computes the gradient at each step.

$>$ Properly updates the parameters using the learning rate.

$>$ Iterates until convergence or max iterations are reached.

Plotting Results $(2$ Points$)$:

$>$ Plots the regression line against the data points.

$>$ Visualizes the cost function over iterations for different learning rates.

Analysis of Learning Rates $(2$ Points$)$:

Discusses the impact of different learning rates on convergence speed and stability. Provide python code