# Question: Suppose you had a neural network with linear activation function

Suppose you had a neural network with linear activation functions. That is, for each unit the output is some constant times the weighted sum of the inputs.

a. Assume that the network has one hidden layer. For a given assignment to the weights W, write down equations for the value of the units in the output layer as a function of W and the input layer I, without any explicit mention to the output of the hidden layer. Show that there is a network with no hidden units that computes the same function.

b. Repeat the calculation in part (a), this time for a network with any number of hidden layers. What can you conclude about linear activation functions?

a. Assume that the network has one hidden layer. For a given assignment to the weights W, write down equations for the value of the units in the output layer as a function of W and the input layer I, without any explicit mention to the output of the hidden layer. Show that there is a network with no hidden units that computes the same function.

b. Repeat the calculation in part (a), this time for a network with any number of hidden layers. What can you conclude about linear activation functions?

**View Solution:**## Answer to relevant Questions

Implement a data structure for layered, feed-forward neural networks, remembering to provide the information needed for both forward evaluation and backward propagation. Using this data structure, write a function ...Starting with the passive ADP agent modify it to use an approximate ADP algorithm us discussed in the text. Do this in two steps:a. Implement a priority queue for adjustments to the utility estimates. Whenever a state is ...Extend the standard game-playing environment to incorporate a reward signal. Put two reinforcement learning agents into the environment (they may, of course, share the agent program) and have them play against each other. ...Which of the following are reasons for introducing a quasi-logical form?a, To make it easier to write simple compositional grammar rules.b. To extend the expressiveness of the semantic representation language.c. To be able ...A firm has fixed costs of $60 and variable costs as indicated in the table below. Calculate the other costs.Instructions:Round your answers so that you enter no more than 2 decimal places.Total ProductÂ Total Variable ...Post your question