Question: Given a NN with two neurons as shown in the following figure, where x 1 , x 2 are two inputs, each represents a binary
Given a NN with two neurons as shown in the following figure, where are two inputs, each
represents a binary bit. We plan to use the simple network to approximate XOR of two bits, and the
desired learning samples are listed in the table.
In this NN model, the activation function at the hidden neuron is Relu, and the activation function at the
output neuron is sigmoid function. We apply the cost function in training, where is the
output and is the target value of the output. Note that the batch gradient descent means that we
consider the four training samples at once when we compute the gradients.
Discuss why crossentropy loss is not a good choice of the cost function in the above task.
Step by Step Solution
There are 3 Steps involved in it
1 Expert Approved Answer
Step: 1 Unlock
Question Has Been Solved by an Expert!
Get step-by-step solutions from verified subject matter experts
Step: 2 Unlock
Step: 3 Unlock
