Chapter 10: Eluding Local Minima

Get the entire book!

In Chapter 5 backpropagation was introduced. Backpropagation is a very effective means of training a neural network. However, there are some inherent flaws in the back propagation training algorithm. One of the most fundamental flaws is the tendency for the backpropagation training algorithm to fall into a “local minima”. A local minimum is a false optimal weight matrix that prevents the backpropagation training algorithm from seeing the true solution.