Accelerating Reinforcement Learning for Autonomous Driving using Task-Agnostic and Ego-Centric Motion Skills

R. S. Sutton, D. Precup, and S. Singh, “Between mdps and semi-mdps: A framework for temporal abstraction in reinforcement learning,” Artificial intelligence , vol. 112, no. 1-2, pp. 181–211, 1999

1999

Earlier work this paper cites.

J. Jing, E. C. Cropper, I. Hurwitz, and K. R. Weiss, “The construction of movement with behavior-specific and behavior-independent modules,” Journal of Neuroscience , vol. 24, no. 28, pp. 6315–6325, 2004

2004

Earlier work this paper cites.

T. M. Howard and A. Kelly, “Optimal rough terrain trajectory generation for wheeled mobile robots,” The International Journal of Robotics Research , vol. 26, no. 2, pp. 141–166, 2007

2007

Earlier work this paper cites.

J. Peters and S. Schaal, “Reinforcement learning of motor skills with policy gradients,” Neural networks , vol. 21, no. 4, pp. 682–697, 2008

2008

Earlier work this paper cites.

B. D. Ziebart, Modeling purposeful adaptive behavior with the principle of maximum causal entropy . Carnegie Mellon University, 2010

2010

Earlier work this paper cites.

M. W. Mueller, M. Hehn, and R. D’Andrea, “A computationally efficient motion primitive for quadrocopter trajectory generation,” IEEE transactions on robotics , vol. 31, no. 6, pp. 1294–1310, 2015

2015

Earlier work this paper cites.

D. Silver, A. Huang, C. J. Maddison, A. Guez, L. Sifre, G. Van Den Driessche, J. Schrittwieser, I. Antonoglou, V. Panneershelvam, M. Lanctot et al. , “Mastering the game of go with deep neural networks and tree search,” nature , vol. 529, no. 7587, pp. 484–489, 2016

2016

Earlier work this paper cites.

M. Vecerik, T. Hester, J. Scholz, F. Wang, O. Pietquin, B. Piot, N. Heess, T. Rothörl, T. Lampe, and M. Riedmiller, “Leveraging demonstrations for deep reinforcement learning on robotics problems with sparse rewards,” arXiv preprint arXiv:1707.08817 , 2017

Original

2017

Earlier work this paper cites.

J. Merel, Y. Tassa, D. TB, S. Srinivasan, J. Lemmon, Z. Wang, G. Wayne, and N. Heess, “Learning human behaviors from motion capture by adversarial imitation,” arXiv preprint arXiv:1707.02201 , 2017

Original

2017

Earlier work this paper cites.

T. Gu, “Improved trajectory planning for on-road self-driving vehicles via combined graph search, optimization & topology analysis,” Ph.D. dissertation, Carnegie Mellon University, 2017

2017

Earlier work this paper cites.

P.-L. Bacon, J. Harb, and D. Precup, “The option-critic architecture,” in Proceedings of the AAAI Conference on Artificial Intelligence , vol. 31, no. 1, 2017

2017

Earlier work this paper cites.

J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms,” CoRR , vol. abs/1707.06347, 2017. [Online]. Available: http://arxiv.org/abs/1707.06347

Original

2017

Earlier work this paper cites.

A. Nair, B. McGrew, M. Andrychowicz, W. Zaremba, and P. Abbeel, “Overcoming exploration in reinforcement learning with demonstrations,” in 2018 IEEE international conference on robotics and automation (ICRA) . IEEE, 2018, pp. 6292–6299

2018

Earlier work this paper cites.

Y. Zhu, Z. Wang, J. Merel, A. Rusu, T. Erez, S. Cabi, S. Tunyasuvunakool, J. Kramár, R. Hadsell, N. de Freitas et al. , “Reinforcement and imitation learning for diverse visuomotor skills,” arXiv preprint arXiv:1802.09564 , 2018

Original

2018

Earlier work this paper cites.

T. Hester, M. Vecerik, O. Pietquin, M. Lanctot, T. Schaul, B. Piot, D. Horgan, J. Quan, A. Sendonaris, I. Osband et al. , “Deep q-learning from demonstrations,” in Proceedings of the AAAI Conference on Artificial Intelligence , vol. 32, no. 1, 2018

2018

Cited alongside, same era.

N. Deo, A. Rangesh, and M. M. Trivedi, “How would surround vehicles move? a unified framework for maneuver classification and motion prediction,” IEEE Transactions on Intelligent Vehicles , vol. 3, no. 2, pp. 129–140, 2018

2018

Cited alongside, same era.

Y. Lee, S.-H. Sun, S. Somasundaram, E. S. Hu, and J. J. Lim, “Composing complex skills by learning transition policies,” in International Conference on Learning Representations , 2018

2018

Cited alongside, same era.

J. Merel, L. Hasenclever, A. Galashov, A. Ahuja, V. Pham, G. Wayne, Y. W. Teh, and N. Heess, “Neural probabilistic motor primitives for humanoid control,” arXiv preprint arXiv:1811.11711 , 2018

Original

2018

Cited alongside, same era.

Z. Li, W. Zhan, L. Sun, C.-Y. Chan, and M. Tomizuka, “Adaptive sampling-based motion planning with a non- conservatively defensive strategy for autonomous driving,” in The 21st IFAC World Congress , 2020

2020

Later among the works it cites.

D. M. Saxena, S. Bae, A. Nakhaei, K. Fujimura, and M. Likhachev, “Driving in dense traffic with model-free reinforcement learning,” in 2020 IEEE International Conference on Robotics and Automation (ICRA) . IEEE, 2020, pp. 5385–5392

2020

Later among the works it cites.

Z. Cao, E. Bıyık, W. Z. Wang, A. Raventos, A. Gaidon, G. Rosman, and D. Sadigh, “Reinforcement learning based control of imitative policies for near-accident driving,” arXiv preprint arXiv:2007.00178 , 2020

Original

2020

Later among the works it cites.

J. Merel, S. Tunyasuvunakool, A. Ahuja, Y. Tassa, L. Hasenclever, V. Pham, T. Erez, G. Wayne, and N. Heess, “Catch & carry: reusable neural controllers for vision-guided whole-body tasks,” ACM Transactions on Graphics (TOG) , vol. 39, no. 4, pp. 39–1, 2020