LSTM used to integer addition
As a first encounter with LSTM's, a little example of how they can do integer addition
The LSTM takes in sequences of integers. After the final integer, we map the final output state into a real number. With L2-loss we train the network.
Some examples after a short training
predicted 17.33 true 18
predicted 21.26 true 22
predicted 9.87 true 11
predicted 20.65 true 21
predicted 19.25 true 20
predicted 22.68 true 23
predicted 23.03 true 23
predicted 15.01 true 16
predicted 12.28 true 13
predicted 20.44 true 21
predicted 24.92 true 26
predicted 14.07 true 15
predicted 19.21 true 20
predicted 22.02 true 23
predicted 16.68 true 18
predicted 24.79 true 26
predicted 20.50 true 21
predicted 14.81 true 16
predicted 15.74 true 17
predicted 21.45 true 22
predicted 18.84 true 19
predicted 25.73 true 27
predicted 15.44 true 16
predicted 12.54 true 13
predicted 24.89 true 26
predicted 15.89 true 17
predicted 22.25 true 23
predicted 14.51 true 15
predicted 6.07 true 6
predicted 22.07 true 23
predicted 19.59 true 20
predicted 19.51 true 20
predicted 16.27 true 17
predicted 25.62 true 27
predicted 18.99 true 20
predicted 15.22 true 16
predicted 17.29 true 18
predicted 28.70 true 31
predicted 18.48 true 19
predicted 21.90 true 23
predicted 12.05 true 13
predicted 16.83 true 17
predicted 10.37 true 11
predicted 20.95 true 22
predicted 12.83 true 14
predicted 15.17 true 16
predicted 22.03 true 22
predicted 21.61 true 22
predicted 13.43 true 14
predicted 21.89 true 22
As always, I am curious to any comments and questions. Reach me at romijndersrob@gmail.com