Question: ( b ) Consider a sample of N = 1 2 5 observations ( x i , y i ) , where, for each obser

(b) Consider a sample of N=125 observations (xi,yi), where, for each obser-
vation i,xi denotes the input variable and yi the numerical target variable
(all quantities are uni-dimensional). From the data, the following summary
quantities can be computed:
i=1Nxiyi=112,i=1Nexi=207
A neural network is trained on these data using the following average loss
function and weight decay penalization function:
E(w)=-1Ni=1N(yixiw-ewxi),Q(w)=12w2.
The network is trained using a gradient descent algorithm with learning rate
equal to 0.05 and penalty parameter equal to 0.5. At iteration (t) the current
estimate of the weight w is 0.75. Using the information available, compute
the updated estimate of w at iteration (t+1).
( b ) Consider a sample of N = 1 2 5 observations

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!