Question: We would like to perform regression task. We choose ( ) = ( ) + = ReLU ( ) and to be the identity function.

We would like to perform regression task. We choose ()=()+= ReLU() and to be the identity function. To train this network, we choose MSE loss function (,)=||,||2, where y is the target output. (25 pts)(a) Name and mathematically describe the 5 programming steps you would take to train this model with PyTorch using SGD on a single batch of data. (b) For a single data point (x, y), write down all inputs and outputs for forward pass of each layer. You can only use: {,,1,1,2,2} in your answer. (Note that ()=+)

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!