Question: Consider a CNN with several convolutional layers followed by a fully - connected layer as the output. Suppose you mistakenly initialize the fully - connected

Consider a CNN with several convolutional layers followed by a fully-connected layer as the output. Suppose you mistakenly initialize the fully-connected layer with all weights to be equal. Additionally, in every individual convolutional layer, all filters have been mistakenly initialized identically, i.e., every filter in a layer is initialized such that it is identical to every other filter in that layer. (a) Show or explain why it is the equivalent of having a single filter in each convolutional layer. (b) Show or explain why no filter will ever learn any new pattern except for the random pattern inherent in its initialization. (Hint: It is sufficient to show or explain that all weights in any filter will always be updated by the same amount.)
Consider a CNN with several convolutional layers

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Programming Questions!