Forward Propagation

The idea of the forward phase is shown in figure 7. The weights of the needed receptive connections of neuron j are one row of the weight matrix. The following values are calculated:

$activation\; of\; neuron\; j\; :\; a$j	$:=$	$\sum$ioi.wji+ &thetas;j
$output\; of\; neuron\; j\; :\; o$j	$:=$	$f(a$j) = {11 + exp(-aj)}