which nn to use

Text is always a somewhat tricky proposition with a neural network. The Elman type neural network has been used for this, which is also a type supported by Encog.

Here is a paper that describes it, and some of how Elman encoded text for a neural network.

http://www.nbu.bg/cogs/events/2003/materials/robert_french/elman_statija...