The machine becomes worse, instead of improving

[Algit73]

Hey Rokas!
Thanks for your code. I am playing with it for a while. What I see, is that the machine like does not learn. It starts with the results that are better than the results it achieves after a while. In the meantime, it acts alternatively, like chasing a sinusoid pattern.
Do you have any idea?