Learning Visual Robotic Control Efficiently with Contrastive Pre-training and Data Augmentation

S. Pirk, M. Khansari, Y. Bai, C. Lynch, and P. Sermanet, “ Online Object Representations with Contrastive Learning ,” CoRR , vol. abs/1906.04312, 2019. [Online]. Available: http://arxiv.org/abs/1906.04312

Original

1906

Earlier work this paper cites.

T. Yu, D. Quillen, Z. He, R. Julian, K. Hausman, C. Finn, and S. Levine, “ Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learning ,” in Conference on Robot Learning (CoRL) , 2019. [Online]. Available: https://arxiv.org/abs/1910.10897

Original

1910

Earlier work this paper cites.

D. Pomerleau, “ ALVINN: an autonomous land vehicle in a neural network,” in Advances in Neural Information Processing Systems 1, [NIPS Conference, Denver, Colorado, USA, 1988] , D. S. Touretzky, Ed. Morgan Kaufmann, 1988, pp. 305–313. [Online]. Available: http://papers.nips.cc/paper/95-alvinn-an-autonomous-land-vehicle-in-a-neural-network

1988

Earlier work this paper cites.

Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner, “Gradient-based learning applied to document recognition,” Proceedings of the IEEE , vol. 86, no. 11, pp. 2278–2324, 1998

1998

Earlier work this paper cites.

A. Y. Ng and S. J. Russell, “Algorithms for inverse reinforcement learning,” in Proceedings of the Seventeenth International Conference on Machine Learning (ICML 2000), Stanford University, Stanford, CA, USA, June 29 - July 2, 2000 , P. Langley, Ed. Morgan Kaufmann, 2000, pp. 663–670

2000

Earlier work this paper cites.

J. Nakanishi, J. Morimoto, G. Endo, G. Cheng, S. Schaal, and M. Kawato, “Learning from demonstration and adaptation of biped locomotion,” Robotics Auton. Syst. , vol. 47, no. 2-3, pp. 79–91, 2004. [Online]. Available: https://doi.org/10.1016/j.robot.2004.03.003

2004

Earlier work this paper cites.

P. Abbeel and A. Y. Ng, “Apprenticeship learning via inverse reinforcement learning,” in Machine Learning, Proceedings of the Twenty-first International Conference (ICML 2004), Banff, Alberta, Canada, July 4-8, 2004 , ser. ACM International Conference Proceeding Series, C. E. Brodley, Ed., vol. 69. ACM, 2004. [Online]. Available: https://doi.org/10.1145/1015330.1015430

2004

Earlier work this paper cites.

R. Hadsell, S. Chopra, and Y. LeCun, “Dimensionality reduction by learning an invariant mapping,” in 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06) , vol. 2. IEEE, 2006, pp. 1735–1742

2006

Earlier work this paper cites.

S. Young, D. Gandhi, S. Tulsiani, A. Gupta, P. Abbeel, and L. Pinto, “ Visual Imitation Made Easy ,” CoRR , vol. abs/2008.04899, 2020. [Online]. Available: https://arxiv.org/abs/2008.04899

Original

2008

Earlier work this paper cites.

M. Kalakrishnan, J. Buchli, P. Pastor, and S. Schaal, “Learning locomotion over rough terrain using terrain templates,” in 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, October 11-15, 2009, St. Louis, MO, USA . IEEE, 2009, pp. 167–172. [Online]. Available: https://doi.org/10.1109/IROS.2009.5354701

2009

Earlier work this paper cites.

S. Ross, G. Gordan, and A. Bagnell, “A reduction of imitation learning and structured prediction to no-regret online learning,” in arXiv preprint arXiv:1011.0686 , 2010

Original

2010

Earlier work this paper cites.

S. Ross, G. J. Gordon, and D. Bagnell, “A reduction of imitation learning and structured prediction to no-regret online learning,” in Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, AISTATS 2011, Fort Lauderdale, USA, April 11-13, 2011 , ser. JMLR Proceedings, G. J. Gordon, D. B. Dunson, and M. Dudík, Eds., vol. 15. JMLR.org, 2011, pp. 627–635. [Online]. Available: http://proceedings.mlr.press/v15/ross11a/ross11a.pdf

2011

Earlier work this paper cites.

M. G. Bellemare, Y. Naddaf, J. Veness, and M. Bowling, “The arcade learning environment: An evaluation platform for general agents,” Journal of Artificial Intelligence Research , vol. 47, pp. 253–279, 2013

2013

Earlier work this paper cites.

V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski et al. , “Human-level control through deep reinforcement learning,” Nature , vol. 518, no. 7540, p. 529, 2015

2015

Earlier work this paper cites.

S. Levine, C. Finn, T. Darrell, and P. Abbeel, “ End-to-End Training of Deep Visuomotor Policies ,” CoRR , vol. abs/1504.00702, 2015. [Online]. Available: http://arxiv.org/abs/1504.00702

Original

2015

Earlier work this paper cites.

T. P. Lillicrap, J. J. Hunt, A. Pritzel, N. Heess, T. Erez, Y. Tassa, D. Silver, and D. Wierstra, “Continuous control with deep reinforcement learning,” arXiv preprint arXiv:1509.02971 , 2015

Original

2015

Earlier work this paper cites.

F. Schroff, D. Kalenichenko, and J. Philbin, “Facenet: A unified embedding for face recognition and clustering,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2015, pp. 815–823

2015

Earlier work this paper cites.

X. Wang and A. Gupta, “Unsupervised learning of visual representations using videos,” in ICCV , 2015

2015

Earlier work this paper cites.

A. Giusti, J. Guzzi, D. C. Ciresan, F. He, J. P. Rodriguez, F. Fontana, M. Faessler, C. Forster, J. Schmidhuber, G. D. Caro, D. Scaramuzza, and L. M. Gambardella, “ A Machine Learning Approach to Visual Perception of Forest Trails for Mobile Robots ,” IEEE Robotics Autom. Lett. , vol. 1, no. 2, pp. 661–667, 2016. [Online]. Available: https://doi.org/10.1109/LRA.2015.2509024

2015

Earlier work this paper cites.

J. Mahler, F. T. Pokorny, B. Hou, M. Roderick, M. Laskey, M. Aubry, K. Kohlhoff, T. Kröger, J. Kuffner, and K. Goldberg, “Dex-net 1.0: A cloud-based network of 3d objects for robust grasp planning using a multi-armed bandit model with correlated rewards,” in ICRA , 2016

2016

Earlier work this paper cites.

G. Brockman, V. Cheung, L. Pettersson, J. Schneider, J. Schulman, J. Tang, and W. Zaremba, “Openai gym,” arXiv preprint arXiv:1606.01540 , 2016

Original

2016

Cited alongside, same era.

M. Bojarski, D. D. Testa, D. Dworakowski, B. Firner, B. Flepp, P. Goyal, L. D. Jackel, M. Monfort, U. Muller, J. Zhang, X. Zhang, J. Zhao, and K. Zieba, “ End to End Learning for Self-Driving Cars ,” CoRR , vol. abs/1604.07316, 2016. [Online]. Available: http://arxiv.org/abs/1604.07316

Original

2016

Cited alongside, same era.

M. Hessel, J. Modayil, H. van Hasselt, T. Schaul, G. Ostrovski, W. Dabney, D. Horgan, B. Piot, M. Azar, and D. Silver, “Rainbow: Combining improvements in deep reinforcement learning,” 2017

2017

Cited alongside, same era.

M. Andrychowicz, F. Wolski, A. Ray, J. Schneider, R. Fong, P. Welinder, B. McGrew, J. Tobin, O. Pieter Abbeel, and W. Zaremba, “Hindsight experience replay,” in NeurIPS , 2017

2017

Cited alongside, same era.

J. Schrittwieser, I. Antonoglou, T. Hubert, K. Simonyan, L. Sifre, S. Schmitt, A. Guez, E. Lockhart, D. Hassabis, T. Graepel et al. , “Mastering atari, go, chess and shogi by planning with a learned model,” arXiv preprint arXiv:1911.08265 , 2019

Original

2019

Later among the works it cites.

P. Florence, L. Manuelli, and R. Tedrake, “Self-supervised correspondence in visuomotor policy learning,” IEEE Robotics and Automation Letters , vol. 5, no. 2, pp. 492–499, 2019

2019

Later among the works it cites.

K. He, H. Fan, Y. Wu, S. Xie, and R. Girshick, “Momentum contrast for unsupervised visual representation learning,” arXiv preprint arXiv:1911.05722 , 2019

Original

2019

Later among the works it cites.

O. J. Hénaff, A. Srinivas, J. De Fauw, A. Razavi, C. Doersch, S. Eslami, and A. v. d. Oord, “Data-efficient image recognition with contrastive predictive coding,” arXiv preprint arXiv:1905.09272 , 2019

Original

2019

Later among the works it cites.