Parallelization

To reduce the computation time for training, the back-propagation algorithm has been parallelized in three ways. Before the different parallelizations are described the backpropagation algorithm is explained.

• Back-Propagation algorithm
  • Forward Propagation
  • Backward Propagation
  • Modified back-propagation
• Batch Learning
• On-line training
  • Parallel backward propagation of Morgan et.al.
  • Parallel backward propagation of Yoon et.al.