I m using a simple sinusoid curve as a dataset
Math.Sin(i * 2 * Math.PI / 200); for i=1 to i=40 000
The network is a simple feed forward network.
I ve no problem training the NN and get to a decent error rate (0.0001).
My issue is that when i do closed loop prediction i get a flat response after a few steps (the output predicted value remains constant).
I did all kind of experiments on the window input (from 1 to 200 input), and on the size of the NN or the error rate. It does not seem to help....
Activation function is tanh but i also tried normalizing between 0 and 1 and using sigmoid as activation.
can you please help me understand what i'm going wrong ?