Question: Consider a two - layer network function of the form ( 5 . 7 ) in which the hidden - unit nonlinear activation functions g

Consider a two-layer network function of the form (5.7) in which the hidden- unit nonlinear activation functions g() are given by logistic sigmoid functions of the
form
1
\sigma (a)={1+ exp(a)}.(5.191)
Show that there exists an equivalent network, which computes exactly the same func- tion, but with hidden unit activation functions given by tanh(a) where the tanh func- tion is defined by (5.59). Hint: first find the relation between \sigma (a) and tanh(a), and then show that the parameters of the two networks differ by linear transformations.

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!