TIDBD: Adapting Temporal-difference Step-sizes Through Stochastic Meta-descent

Adapting bias by gradient descent: An incremental version of delta-bar-delta

Sutton, R. S. (1992) · 1992

Earlier work this paper cites.

Temporal-difference methods and markov models

Barnard, E. (1993) · 1993

Earlier work this paper cites.

Reinforcement learning: An introduction

Sutton, R. S. and Barto, A. G. (1998) · 1998

Earlier work this paper cites.

Local gain adaptation in stochastic gradient descent

Schraudolph, N. N. (1999) · 1999

Earlier work this paper cites.

Temporal difference updating without a learning rate

Hutter, M., Legg, S., et al. (2007) · 2007

Earlier work this paper cites.

Horde: A scalable real-time architecture for learning knowledge from unsupervised sensorimotor interaction

Sutton, R. S., Modayil, J., Delp, M., Degris, T., Pilarski, P. M., White, A., and Precup, D. (2011) · 2011

Cited alongside, same era.

Adaptive step-size for online temporal difference learning

Dabney, W. and Barto, A. G. (2012) · 2012

Cited alongside, same era.

Tuning-free step-size adaptation

Mahmood, A. R., Sutton, R. S., Degris, T., and Pilarski, P. M. (2012) · 2012

Cited alongside, same era.

Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude

Tieleman, T. and Hinton, G. (2012) · 2012

Cited alongside, same era.

Adaptive step-sizes for reinforcement learning

Dabney, W. (2014) · 2014

Later among the works it cites.

A collaborative approach to the simultaneous multi-joint control of a prosthetic arm

Sherstan, C., Modayil, J., and Pilarski, P. M. (2015) · 2015

Later among the works it cites.

Application of real-time machine learning to myoelectric prosthesis control: A case series in adaptive switching

Edwards, A. L., Dawson, M. R., Hebert, J. S., Sherstan, C., Sutton, R. S., Chan, K. M., and Pilarski, P. M. (2016) · 2016

Later among the works it cites.

True online temporal-difference learning

van Seijen, H., Mahmood, A. R., Pilarski, P. M., Machado, M. C., and Sutton, R. S. (2016) · 2016

Later among the works it cites.