Simple Recurrent Neural Net vs. LSTMs: Awesome Visualization of Error Flow
m.imgur.com