Question: The network given in the figure is trained by backpropagation algorithm. The sigmoidal activation functions used in the network are parametric ( ai s are

The network given in the figure is trained by backpropagation algorithm. The sigmoidal activation functions used in the network are parametric (ais are the parameters and they are updated at each iteration together with the weights). The activation functions are given as a v e v 1111, a v e v 2112, a v e v 3113, a v e v 4114, a v e v 5115 and a v e v 6116 with a1=a2=a3=a4=a5==1. The weights are given as w1=0.1, w2=0.3, w3=0.4, w4=0.2, w5=0.6, w6=0.5, w7=0.9, w8=0.8, w9=0.1, w10=1.2, w11=0.2 and w12=1, w13=0.4, w14=0.9, w15=0.5, w16=1.5. Assume: 222121 E e e ,111 e d y ,222 e d y ,1 d1 d2,0.2(d1 and d2 are desired outputs for output neurons and is the learning rate).(a) For one forward pass, calculate y1 and y2.(b) Write down the update rule for w9 and determine the updated value of w9 for one iteration. (c) Write down the update rule for w1 and determine the updated value of w1 for one iteration. (d) Write down the update rule for a1 and determine the updated value of a1 for one iteration.

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!