Question: [ 3 0 marks ] Linear regression aims to fit a linear function h ( v e c ( x ) ) = vec (

[30 marks] Linear regression aims to fit a linear function h(vec(x))=vec()T*vec(x)=0+1x1+2x2+dotsdots+nxn based on the training set D={vec(x)(i),y(i)i=1,2,dots,m to predict the numerical output y for a new input vector vec(x). Please derive the update rules for both stochastic and batch gradient descent methods to iteratively update vec(), aiming to minimize the least squares cost function J(vec()) of linear regression.
J(vec())=12i=1m[h(vec(x)(i))-y(i)]2
[ 3 0 marks ] Linear regression aims to fit a

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!