Learning to Predict by the Methods of Temporal Differences

Richard S. Sutton published 'Learning to Predict by the Methods of Temporal Differences' in Machine Learning in 1988. The paper introduces a class of incremental prediction-learning procedures that assign credit using differences between temporally successive predictions and studies convergence and optimality in special cases.