Question: 2. Neural Networks. Consider a neural network, with Ni=2 input units, x=(x1,x2),Nh=3 hidden units with ReLU activations and one output unit for regression, zjHy=k=1NiWjkHxk+bjH,ujH=max{0,zjH},j=1,,Nh=k=1NhWkOukH+bO, (a)

 2. Neural Networks. Consider a neural network, with Ni=2 input units,

2. Neural Networks. Consider a neural network, with Ni=2 input units, x=(x1,x2),Nh=3 hidden units with ReLU activations and one output unit for regression, zjHy=k=1NiWjkHxk+bjH,ujH=max{0,zjH},j=1,,Nh=k=1NhWkOukH+bO, (a) Suppose that WH=101011,bH=0.513 Write equations for zjH in terms of x for j=1,2,3. (b) Draw the region of inputs (x1,x2) where ujH>0 for all j. (c) You are given data x, y as well as weights and biases wh,bh for the hidden layer. Write a few lines of python code to fit wo, bo for the output layer by minimizing the MSE. You may assume you have a function

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!