Question: Consider a two - layer network function of the form ( 5 . 7 ) in which the hidden - unit nonlinear activation functions g
Consider a twolayer network function of the form in which the hidden unit nonlinear activation functions g are given by logistic sigmoid functions of the
form
sigma a expa
Show that there exists an equivalent network, which computes exactly the same func tion, but with hidden unit activation functions given by tanha where the tanh func tion is defined by Hint: first find the relation between sigma a and tanha and then show that the parameters of the two networks differ by linear transformations.
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
