Question: Consider a neural network that represents the following function: hat ( y ) = ( w 5 ( w 1 x 1 + w 2

Consider a neural network that represents the following function:
hat(y)=(w5(w1x1+w2x2)+w6(w3x3+w4x4))
where xi denotes input variables, hat(y) is the output variable, and is the logistic function:
(x)=11+e-x.
Suppose the loss function used for training this neural network is the L2 loss, i.e.L(y,hat(y))=
(y-hat(y))2. Assume that the network has its weights set as:
(w1,w2,w3,w4,w5,w6)=(-0.65,-0.55,1.74,0.79,-0.13,0.93)
[3.a](5 marks) Draw the computational graph for this function. Define appropriate in-
termediate variables on the computational graph. (break the logistic function into smaller
components.)
[3.b](5 marks) Given an input data point (x1,x2,x3,x4)=(1.2,-1.1,0.8,0.7) with true
label of 1.0, compute the partial derivative delLw3, by using the back-propagation algorithm.
Indicate the partial derivatives of your intermediate variables on the computational graph.
Round all your calculations to 4 decimal places.
 Consider a neural network that represents the following function: hat(y)=(w5(w1x1+w2x2)+w6(w3x3+w4x4)) where

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!