Jeffrey L. Elman

The Elman neural network is a simple recurrent neural network (SRN) developed by Jeffrey L. Elman in 1990. This network type consists of an input layer, a hidden layer, and an ouput layer. In this way it resembles a three layer feedforward neural network. However, it also has a context layer. This context layer is fed, without weighting, the output from the hidden layer. The Elman network then remembers these value and outputs them on the next run of the neural network. These values are then sent, using a trainable weighted connection, back into the hidden layer.