Question: Suppose you had a neural network with linear activation functions. That is, for each unit the output is some constant times the weighted sum of

Suppose you had a neural network with linear activation functions. That is, for each unit the output is some constant times the weighted sum of the inputs.

a. Assume that the network has one hidden layer. For a given assignment to the weights W, write down equations for the value of the units in the output layer as a function of W and the input layer I, without any explicit mention to the output of the hidden layer. Show that there is a network with no hidden units that computes the same function.

b. Repeat the calculation in part (a), this time for a network with any number of hidden layers. What can you conclude about linear activation functions?

Step by Step Solution

★★★★★

3.41 Rating (176 Votes )

There are 3 Steps involved in it

1 Expert Approved Answer

Step: 1 Unlock

This exercise reinforces the students understanding of neural networks as mathemat ical functions th... View full answer

Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock

Step: 3 Unlock

Document Format (1 attachment)

21-C-S-A-I (293).docx

120 KBs Word File

Students Have Also Explored These Related Artificial Intelligence Questions!

What can you conclude about the relative risk of investing in the United States versus Japan from Figure 7.4?

What can you conclude about the ratio of fugacity to pressure for N 2 ,H 2 , and NH 3 at 500 bar using the data in Figure 7.10? Figure 7.10 1.5 H2, 1.4 N2 1.3 1.2 1.1 1.0 100 200 300 400 500 600 700...

Suppose you had a relative deposit $10.07 at 5.5% interest 200 years ago. How much would the investment be worth today?

Suppose you had a neural network with linear activation functions. That is , for each unit the output is some constant c times the weighted sum of the inputs. a . Assume that the network has one...

Suppose you had a neural network with linear activation functions. That is , for each unit the output is some constant c times the weighted sum of the inputs. Assume that the network has one hidden...

1 Suppose you had a neural network with linear activation functions. That is, for each unit the output is some constant c times the weighted sum of the inputs. a. Assume that the network has one...

Unfortunately, directly representing A + B + C + D + E where + represents XNOR with a simple multilayer neural network using linear activation functions is impossible, as explained before. However,...

4. A. The neural network shown in the following figure is presented with the input pattern [0, 1] and target output 1. 0.3 0.6 0.4 -0.2 -0.1 Output -0.3 X2 0.1 0.4 0.5 Figure 4. Neural network...

1. slide 19 and 2.slide 20 Single (Hidden) Layer Neural Network zj=w0,j(1)+i=13xiwi,j(1),yk=w0,k(2)+j=1k=1,2,3,4.4g(zj)wj,k(2), Q1: For the perceptron, what are the model parameters to leam based on...

A gymnast is swinging on a high bar. The distance between his waist and the bar is 1.1 m, as the drawing shows. At the top of the swing, his speed is momentarily zero. Ignoring friction and treating...

In the Western United States there is a saying, "Whisky is for drinken but water is for fighten!" Water and water rights have been fought over ever since ranchers and settlers moved into Wyoming,...

Suppose you are attempting to buy a house ( you are the buyer ) and you are bargaining with the current owner over the sale price. Your maximum willingness to pay for the house is $ 9 0 0 , 0 0 0 ,...

Market-share-analysis company Net Applications monitors and reports on Internet browser usage. According to Net Applications, in the summer of 2014, google's Chrome browser exceeded a 20% market...

Three years ago and at a cost of $40,000, Paul Sanders acquired stock in a corporation that qualified as a small business corporation under 1244. A few months after he acquired the stock, when it...

During May, the production department of a process manufacturing system completed a number of units of a product and transferred them to finished goods. Of these transferred units, 37,500 were in...

Sam, a single taxpayer, acquired stock in a corporation that qualified as a small business corporation under 1244 at a cost of $100,000 three years ago. He sells the stock for $10,000 in the current...

Red Corporation wants to set up a manufacturing facility in a mid western state. After considerable negotiations with a small town in Ohio, Red accepts the following offer: land (fair market value of...

Imagine that you are living in poverty and therefore benefit from numerous anti-poverty programs. You are offered a relatively good job. Are there any reasons why you might turn it down?

What are the three methods for solving the problem of grouping parts into part families?

What is the difference between a hierarchical structure and a chain-type structure in a classification and coding scheme?

1 Construct a support vector machine that computes the XOR function. Use values of +1 and 1 (instead of 1 and 0) for both inputs and outputs, so that an example looks like ([1, 1], 1) or ([1,1],1)....

1 Consider an ensemble learning algorithm that uses simple majority voting among K learned hypotheses. Suppose that each hypothesis has error and that the errors made by each hypothesis are...

1 Recall that there are 2 distinct Boolean functions of n inputs. How many of these are representable by a threshold perceptron?

Show that any one-asymmetric error correcting code of length n can have a maximum of 2^n/(1 +n/2) codewords.