Let W $[1],$ b$[1]$ represent the weight and bias parameters from the input to the hidden

layer and W $[2],$ b$[2]$ represent the weight and bias parameters from the hidden layer to

the output layer. Assume that a sigmoid activation function is applied at each node of

the hidden layer and the softmax function is applied at the output layer. The softmax

function defined for this network is given by