Reinforcement Learning of Control Policy for Linear Temporal Logic Specifications Using Limit-Deterministic Generalized B\"uchi Automata

M. L. Puterman, Markov Decision Processes: Discrete Stochastic Dynamic Programming . John Wiley & Sons, 1994

1994

Earlier work this paper cites.

S. M. Ross, Stochastic Processes , 2nd ed. Wiley New York, 1996

1996

Earlier work this paper cites.

S. Singh, T. Jaakkola, M. L. Littman, and C. Szepesvári, “Convergence results for single-step on-policy reinforcement-learning algorithms,” Machine learning , vol. 38, no. 3, pp. 287–308, 2000

2000

Earlier work this paper cites.

C. Baier and J.-P. Katoen, Principles of Model Checking . MIT Press, 2008

2008

Earlier work this paper cites.

R. Durrett, Essentials of Stochastic Processes , 2nd ed. Springer, 2012

2012

Earlier work this paper cites.

D. Sadigh, E. S. Kim, S. Coogan, S. S. Sastry, and S. A. Seshia, “A learning based approach to control synthesis of Markov decision processes for linear temporal logic specifications,” in 53rd IEEE Conference on Decision and Control , 2014, pp. 1091–1096

2014

Cited alongside, same era.

S. Sickert, J. Esparza, S. Jaax, and J. Křetínskỳ, “Limit-deterministic Büchi automata for linear temporal logic,” in International Conference on Computer Aided Verification . Springer, 2016, pp. 312–332

2016

Cited alongside, same era.

C. Belta, B. Yordanov, and E. Aydin Gol, Formal Methods for Discrete-Time Dynamical Systems . Springer International Publishing, 2017

2017

Cited alongside, same era.

R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction , 2nd ed. MIT press, 2018

2018

Cited alongside, same era.

M. Hasanbeig, A. Abate, and D. Kroening, “Logically-constrained reinforcement learning,” arXiv preprint arXiv:1801.08099 , 2018

Q. Gao, D. Hajinezhad, Y. Zhang, Y. Kantaros, and M. M. Zavlanos, “Reduced variance deep reinforcement learning with temporal logic specifications,” in Proceedings of the 10th ACM/IEEE International Conference on Cyber-Physical Systems , 2019, pp. 237–248

2019

Later among the works it cites.

X. Li, Z. Serlin, G. Yang, and C. Belta, “A formal methods approach to interpretable reinforcement learning for robotic planning,” Science Robotics , vol. 4, no. 37, pp. 1–16, 2019

2019

Later among the works it cites.

M. Hasanbeig, Y. Kantaros, A. Abate, D. Kroening, G. J. Pappas, and I. Lee, “Reinforcement learning for temporal logic control synthesis with probabilistic satisfaction guarantees,” arXiv preprint arXiv:1909.05304 , 2019

Original

2019

Later among the works it cites.

E. M. Hahn, M. Perez, S. Schewe, F. Somenzi, A. Trivedi, and D. Wojtczak, “Omega-regular objectives in model-free reinforcement learning,” in International Conference on Tools and Algorithms for the Construction and Analysis of Systems . Springer, 2019, pp. 395–412