Dynamics of stochastic approximation with iterate-dependent Markov noise under verifiable conditions in compact state space with the stability of iterates not ensured

M.Metivier and P.Priouret, “Applications of a Kushner-Clark lemma to general classes of stochastic algorithms,” IEEE Transactions on Information Theory

1984

Earlier work this paper cites.

Berlin - New York: Springer Verlag, 1990

A.Benveniste, M.Metivier, and P.Priouret, Adaptive Algorithms and Stochastic Approximation · 1990

Earlier work this paper cites.

R.Permantle, “Nonconvergence to unstable points in urn models and stochastic approximations,” Annals of Probability

1990

Earlier work this paper cites.

University of Michigan Press, 1994

W.B.Arthur, Increasing Returns and Path Dependence in the Economy · 1994

Earlier work this paper cites.

O.Brandiere, “Some pathological traps for stochastic approximation,” SIAM Journal on Control and Optimization

1998

Earlier work this paper cites.

Berlin-Heidelberg: Springer Verla, 1998

M.Habib, C.McDiarmid, J.Ramirez-Alfonsin, and B.Reed, ’Concentration’, in Probabilistic Methods for Algorithmic Discrete Mathematics · 1998

Earlier work this paper cites.

V.S.Borkar and S. Meyn, “The o.d.e. method for convergence of stochastic approximation and reinforcement learning,” SIAM Journal on Control and Optimization

2000

Earlier work this paper cites.

V.S.Borkar, “On the lock-in probability of stochastic approximation,” Combinatorics, Probability and Computing

2002

Earlier work this paper cites.

New York: Springer, 2nd ed., 2003

H.J.Kushner and G.Yin, Stochastic Approximation and Recursive Algorithms and Applications · 2003

Earlier work this paper cites.

V.R.Konda and J.N.Tsitsiklis, “Linear stochastic approximation driven by slowly varying Markov chains,” Systems and Control Letters

2003

Cited alongside, same era.

Cambridge University Press, 2008

V.S.Borkar, Stochastic Approximation : A Dynamic Systems Viewpoint · 2008

Cited alongside, same era.

A.Nemirovski, A.Juditsky, G.Lan, and A.Shapiro, “RobusT Stochastic Approximation Approach to Stochastic Programming,” SIAM Journal on Optimization

2009

Cited alongside, same era.

S.Kamal, “On the convergence, lock-In probability, and sample complexity of stochastic approximation,” SIAM Journal on Control and Optimization

2010

Cited alongside, same era.

M.Broadie, D.Cicek, and A.Zeevi, “General Bounds and Finite-Time Improvement for the Kiefer-Wolfowitz Stochastic Approximation Algorithm,” Operations Research

2010

Cited alongside, same era.

L.Rosasco and T.Poggio, “Consistency, Learnability, and Regularization,” Lecture Notes for MIT Course 9.520

2015

Later among the works it cites.

H.F.Chen, “Stochastic approximation and its applications,” SIAM Journal on Control and Optimization

2016

Closest in time.

G.Dalal, B.Szorenyi, G.Thoppe, and S.Mannor, “Finite sample analysis of two-timescale stochastic approximation with applications to reinforcement learning,” Conference on Learning Theory (COLT)

2018

Closest in time.

G.Thoppe and V.S.Borkar, “A concentration bound for stochastic approximation via Alekseev’s formula,” Stochastic Systems(To Appear)

2018

Closest in time.

P.Karmakar and S.Bhatnagar, “Two timescale stochastic approximation with controlled Markov noise and off-policy temporal difference learning,” Mathematics of Operations Research

2018

Closest in time.