Output Layer Computation

The q^th neuron of the output layer is shown below. It has input from the output of the hidden neurons layers. If we consider transfer function as sigmoidal function then the output of the q^th output neuron is given by

Where,

O_Oq is the output of the q^th output neuron,

I_Oq is the input to the q^thoutput neuron, and

θ_Oq is the threshold of the q^th neuron;

A non-zero threshold neuron, is computationally equivalent to an input that is always held at -1 and the non-zero threshold becomes the connecting weight value.

The threshold may be tackled by considering extra O^th neuron in the hidden layer with output of -1 and the threshold value θ_Oqbecomes the connecting weight value.