Question: Given a NN with two neurons as shown in the following figure, where x 1 , x 2 are two inputs, each represents a binary

Given a NN with two neurons as shown in the following figure, where x1,x2 are two inputs, each
represents a binary bit. We plan to use the simple network to approximate XOR of two bits, and the
desired learning samples are listed in the table.
In this NN model, the activation function at the hidden neuron is Relu, and the activation function at the
output neuron is sigmoid function. We apply the cost function C=12(y-t)2 in training, where y is the
output and t is the target value of the output. Note that the batch gradient descent means that we
consider the four training samples at once when we compute the gradients.
(2) Discuss why cross-entropy loss is not a good choice of the cost function in the above task.
 Given a NN with two neurons as shown in the following

Step by Step Solution

There are 3 Steps involved in it

1 Expert Approved Answer
Step: 1 Unlock blur-text-image
Question Has Been Solved by an Expert!

Get step-by-step solutions from verified subject matter experts

Step: 2 Unlock
Step: 3 Unlock

Students Have Also Explored These Related Databases Questions!