Fetching the paper…
Reading the bibliography…
Reinforcement learning (RL) holds great promise for enabling autonomous acquisition of complex robotic manipulation skills, but realizing this potential in real-world settings has been challenging.
Sample-optimal parametric q-learning using linearly additive features, 2019
Lin F. Yang and Mengdi Wang · 1902
Earlier work this paper cites.
Is a good representation sufficient for sample efficient reinforcement learning?, 2020
Simon S. Du, Sham M. Kakade, Ruosong Wang, and Lin F. Yang · 1910
Earlier work this paper cites.
Big transfer (bit): General visual representation learning, 2020
Alexander Kolesnikov, Lucas Beyer, Xiaohua Zhai, Joan Puigcerver, Jessica Yung, Sylvain Gelly, and Neil Houlsby · 1912
Earlier work this paper cites.
Dynamic manipulation
M.T. Mason and K.M. Lynch · 1993
Earlier work this paper cites.
Applying lean principles for high product variety and low volumes: some issues and propositions
Jay Jina, Arindam K. Bhattacharya, and Andrew Walton · 1997
Earlier work this paper cites.
Near-optimal reinforcement learning in polynominal time
Michael J. Kearns and Satinder P. Singh · 1998
Earlier work this paper cites.
Sequential composition of dynamically dexterous robot behaviors
R. R. Burridge, A. A. Rizzi, and D. E. Koditschek · 1999
Earlier work this paper cites.
Policy invariance under reward transformations: Theory and application to reward shaping
Andrew Y. Ng, Daishi Harada, and Stuart J. Russell · 1999
Earlier work this paper cites.
Convergence of reinforcement learning with general function approximators
Vassilis A. Papavassiliou and Stuart Russell · 1999
Earlier work this paper cites.
Lean manufacturing: context, practice bundles, and performance
Rachna Shah and Peter T Ward · 2003
Earlier work this paper cites.
Feedback Systems: An Introduction for Scientists and Engineers
Karl Johan Astrom and Richard M. Murray · 2008
Earlier work this paper cites.
Imagenet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei · 2009
Earlier work this paper cites.
Reinforcement learning for robot soccer
Martin Riedmiller, Thomas Gabel, Roland Hafner, and Sascha Lange · 2009
Earlier work this paper cites.
An image is worth 16x16 words: Transformers for image recognition at scale, 2021
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby · 2010
Earlier work this paper cites.
Robot motor skill coordination with em-based reinforcement learning
Petar Kormushev, Sylvain Calinon, and Darwin G. Caldwell · 2010
Earlier work this paper cites.
Lqr-trees: Feedback motion planning via sums-of-squares verification
Russ Tedrake, Ian R. Manchester, Mark Tobenkin, and John W. Roberts · 2010
Earlier work this paper cites.
A generalized path integral control approach to reinforcement learning
Evangelos Theodorou, Jonas Buchli, and Stefan Schaal · 2010
Earlier work this paper cites.
A reduction of imitation learning and structured prediction to no-regret online learning
Stéphane Ross, Geoffrey Gordon, and Drew Bagnell · 2011
Earlier work this paper cites.
On the sample complexity of reinforcement learning with a generative model, 2012
Mohammad Gheshlaghi Azar, Remi Munos, and Bert Kappen · 2012
Earlier work this paper cites.
Texplore: real-time sample-efficient reinforcement learning for robots
Todd Hester and Peter Stone · 2013
Earlier work this paper cites.
Dynamical movement primitives: Learning attractor models for motor behaviors
Auke Jan Ijspeert, Jun Nakanishi, Heiko Hoffmann, Peter Pastor, and Stefan Schaal · 2013
Earlier work this paper cites.
Playing atari with deep reinforcement learning
Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller · 2013
Earlier work this paper cites.
Deep residual learning for image recognition, 2015
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2015
Earlier work this paper cites.
Usb assembly strategy based on visual servoing and impedance control
Hee-Chan Song, Min-Cheol Kim, and Jae-Bok Song · 2015
Earlier work this paper cites.
Deep reinforcement learning with double q-learning, 2015
Hado van Hasselt, Arthur Guez, and David Silver · 2015
Earlier work this paper cites.
Path integral guided policy search, 2016
Yevgen Chebotar, Mrinal Kalakrishnan, Ali Yahya, Adrian Li, Stefan Schaal, and Sergey Levine · 2016
Earlier work this paper cites.
Francois Robert Hogan and Alberto Rodriguez · 2016
Earlier work this paper cites.
End-to-end training of deep visuomotor policies
Sergey Levine, Chelsea Finn, Trevor Darrell, and Pieter Abbeel · 2016
Earlier work this paper cites.
Autonomous alignment of peg and hole by force/torque measurement for robotic assembly
Te Tang, Hsien-Chung Lin, Yu Zhao, Wenjie Chen, and Masayoshi Tomizuka · 2016
Earlier work this paper cites.
Reverse curriculum generation for reinforcement learning
Carlos Florensa, David Held, Markus Wulfmeier, Michael Zhang, and Pieter Abbeel · 2017
Earlier work this paper cites.
Approximate hybrid model predictive control for multi-contact push recovery in complex environments
Tobia Marcucci, Robin Deits, Marco Gabiccini, Antonio Bicchi, and Russ Tedrake · 2017
Earlier work this paper cites.
Data-efficient deep reinforcement learning for dexterous manipulation
Ivaylo Popov, Nicolas Heess, Timothy Lillicrap, Roland Hafner, Gabriel Barth-Maron, Matej Vecerik, Thomas Lampe, Yuval Tassa, Tom Erez, and Martin Riedmiller · 2017
Earlier work this paper cites.
A finite time analysis of temporal difference learning with linear function approximation
Jalaj Bhandari, Daniel Russo, and Raghav Singal · 2018
Cited alongside, same era.
Automatic goal generation for reinforcement learning agents, 2018
Carlos Florensa, David Held, Xinyang Geng, and Pieter Abbeel · 2018
Cited alongside, same era.
Variational inverse control with events: A general framework for data-driven reward definition
Justin Fu, Avi Singh, Dibya Ghosh, Larry Yang, and Sergey Levine · 2018
Cited alongside, same era.
Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor
Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, and Sergey Levine · 2018
Cited alongside, same era.
Is q-learning provably efficient?
Chi Jin, Zeyuan Allen-Zhu, Sebastien Bubeck, and Michael I Jordan · 2018
Cited alongside, same era.
Offline reinforcement learning from images with latent space models
Rafael Rafailov, Tianhe Yu, Aravind Rajeswaran, and Chelsea Finn · 2021
Later among the works it cites.
Autonomous reinforcement learning: Benchmarking and formalism
Archit Sharma, Kelvin Xu, Nikhil Sardana, Abhishek Gupta, Karol Hausman, Sergey Levine, and Chelsea Finn · 2021
Later among the works it cites.
Robot precision assembly combining with passive and active compliant motions
Jianhua Su, Chuankai Liu, and Rui Li · 2021
Later among the works it cites.
Sample-efficient reinforcement learning in robotic table tennis
Jonas Tebbe, Lukas Krauch, Yapeng Gao, and Andreas Zell · 2021
Later among the works it cites.
A framework for efficient robotic manipulation
Albert Zhan, Ruihan Zhao, Lerrel Pinto, Pieter Abbeel, and Michael Laskin · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Dmitry Kalashnikov, Alex Irpan, Peter Pastor, Julian Ibarz, Alexander Herzog, Eric Jang, Deirdre Quillen, Ethan Holly, Mrinal Kalakrishnan, Vincent Vanhoucke, and Sergey Levine · 2018
Cited alongside, same era.
Hg-dagger: Interactive imitation learning with human experts
Michael Kelly, Chelsea Sidrane, K. Driggs-Campbell, and Mykel J. Kochenderfer · 2018
Cited alongside, same era.
Deep reinforcement learning for robotic assembly of mixed deformable and rigid objects
Jianlan Luo, Eugen Solowjow, Chengtao Wen, Juan Aparicio Ojea, and Alice M Agogino · 2018
Cited alongside, same era.
Learning complex dexterous manipulation with deep reinforcement learning and demonstrations
Aravind Rajeswaran, Vikash Kumar, Abhishek Gupta, Giulia Vezzani, John Schulman, Emanuel Todorov, and Sergey Levine · 2018
Cited alongside, same era.
See, feel, act: Hierarchical learning for complex manipulation skills with multisensory fusion
N. Fazeli, M. Oller, J. Wu, Z. Wu, J. B. Tenenbaum, and A. Rodriguez · 2019
Cited alongside, same era.
Learning agile and dynamic motor skills for legged robots
Jemin Hwangbo, Joonho Lee, Alexey Dosovitskiy, Dario Bellicoso, Vassilios Tsounis, Vladlen Koltun, and Marco Hutter · 2019
Cited alongside, same era.
Robust deformation model approximation for robotic cable manipulation
Shiyu Jin, Changhao Wang, and Masayoshi Tomizuka · 2019
Cited alongside, same era.
Minedojo: Building open-ended embodied agents with internet-scale knowledge
Linxi Fan, Guanzhi Wang, Yunfan Jiang, Ajay Mandlekar, Yuncong Yang, Haoyi Zhu, Andrew Tang, De-An Huang, Yuke Zhu, and Anima Anandkumar · 2022
Later among the works it cites.
Zero-shot reward specification via grounded natural language
Parsa Mahmoudieh, Deepak Pathak, and Trevor Darrell · 2022
Later among the works it cites.
Oren Spector, Vladimir Tchuiev, and Dotan Di Castro · 2022
Later among the works it cites.
Autonomously untangling long cables, 2022
Vainavi Viswanath, Kaushik Shivakumar, Justin Kerr, Brijen Thananjeyan, Ellen Novoseller, Jeffrey Ichnowski, Alejandro Escontrela, Michael Laskey, Joseph E. Gonzalez, and Ken Goldberg · 2022
Later among the works it cites.
Daydreamer: World models for physical robot learning
Philipp Wu, Alejandro Escontrela, Danijar Hafner, Pieter Abbeel, and Ken Goldberg · 2022
Later among the works it cites.
When to ask for help: Proactive interventions in autonomous reinforcement learning
Annie Xie, Fahim Tajwar, Archit Sharma, and Chelsea Finn · 2022
Later among the works it cites.
Offline meta-reinforcement learning for industrial insertion
Tony Z. Zhao, Jianlan Luo, Oleg Sushkov, Rugile Pevceviciute, Nicolas Heess, Jon Scholz, Stefan Schaal, and Sergey Levine · 2022
Later among the works it cites.
Efficient online reinforcement learning with offline data
Philip J Ball, Laura Smith, Ilya Kostrikov, and Sergey Levine · 2023
Later among the works it cites.
Visual dexterity: In-hand reorientation of novel and complex object shapes
Tao Chen, Megha Tippur, Siyang Wu, Vikash Kumar, Edward Adelson, and Pulkit Agrawal · 2023
Later among the works it cites.
Vision-language models as success detectors
Yuqing Du, Ksenia Konyushkova, Misha Denil, Akhil Raju, Jessica Landon, Felix Hill, Nando de Freitas, and Serkan Cabi · 2023
Later among the works it cites.
Demonstrating A walk in the park: Learning to walk in 20 minutes with model-free reinforcement learning
Ilya Kostrikov, Laura M. Smith, and Sergey Levine · 2023
Later among the works it cites.
Rlif: Interactive imitation learning as reinforcement learning
Jianlan Luo, Perry Dong, Yuexiang Zhai, Yi Ma, and Sergey Levine · 2023
Later among the works it cites.
LIV: language-image representations and rewards for robotic control
Yecheng Jason Ma, Vikash Kumar, Amy Zhang, Osbert Bastani, and Dinesh Jayaraman · 2023
Later among the works it cites.
VIP: towards universal visual reward and representation via value-implicit pre-training
Yecheng Jason Ma, Shagun Sodhani, Dinesh Jayaraman, Osbert Bastani, Vikash Kumar, and Amy Zhang · 2023
Later among the works it cites.
Self-improving robots: End-to-end autonomous visuomotor reinforcement learning
Archit Sharma, Ahmed M. Ahmed, Rehaan Ahmad, and Chelsea Finn · 2023
Later among the works it cites.
Sgtm 2.0: Autonomously untangling long cables using interactive perception
Kaushik Shivakumar, Vainavi Viswanath, Anrui Gu, Yahav Avigal, Justin Kerr, Jeffrey Ichnowski, Richard Cheng, Thomas Kollar, and Ken Goldberg · 2023
Later among the works it cites.
Hybrid RL: Using both offline and online data can make RL efficient
Yuda Song, Yifei Zhou, Ayush Sekhari, Drew Bagnell, Akshay Krishnamurthy, and Wen Sun · 2023
Later among the works it cites.
Handloom: Learned tracing of one-dimensional objects for inspection and manipulation, 2023
Vainavi Viswanath, Kaushik Shivakumar, Jainil Ajmera, Mallika Parulekar, Justin Kerr, Jeffrey Ichnowski, Richard Cheng, Thomas Kollar, and Ken Goldberg · 2023
Later among the works it cites.
Insert-one: One-shot robust visual-force servoing for novel object insertion with 6-dof tracking
Haonan Chang, Abdeslam Boularias, and Siddarth Jain · 2024
Closest in time.
Diffusion policy: Visuomotor policy learning via action diffusion, 2024
Cheng Chi, Zhenjia Xu, Siyuan Feng, Eric Cousineau, Yilun Du, Benjamin Burchfiel, Russ Tedrake, and Shuran Song · 2024
Closest in time.
Open X-Embodiment: Robotic learning datasets and RT-X models
Open X-Embodiment Collaboration, Abhishek Padalkar, Acorn Pooley, Ajinkya Jain, Alex Bewley, Alex Herzog, Alex Irpan, Alexander Khazatsky, Anant Rai, Anikait Singh, Anthony Brohan, Antonin Raffin, Ayzaan Wahid, Ben Burgess-Limerick, Beomjoon Kim, Bernhard Schölkopf, Brian Ichter, Cewu Lu, Charles Xu, Chelsea Finn, Chenfeng Xu, Cheng Chi, Chenguang Huang, Christine Chan, Chuer Pan, Chuyuan Fu, Coline Devin, Danny Driess, Deepak Pathak, Dhruv Shah, Dieter Büchler, Dmitry Kalashnikov, Dorsa Sadigh, Edward Johns, Federico Ceola, Fei Xia, Freek Stulp, Gaoyue Zhou, Gaurav S. Sukhatme, Gautam Salhotra, Ge Yan, Giulio Schiavi, Hao Su, Hao-Shu Fang, Haochen Shi, Heni Ben Amor, Henrik I Christensen, Hiroki Furuta, Homer Walke, Hongjie Fang, Igor Mordatch, Ilija Radosavovic, Isabel Leal, Jacky Liang, Jaehyung Kim, Jan Schneider, Jasmine Hsu, Jeannette Bohg, Jeffrey Bingham, Jiajun Wu, Jialin Wu, Jianlan Luo, Jiayuan Gu, Jie Tan, Jihoon Oh, Jitendra Malik, Jonathan Tompson, Jonathan Yang, Joseph J. Lim, João Silvério, Junhyek Han, Kanishka Rao, Karl Pertsch, Karol Hausman, Keegan Go, Keerthana Gopalakrishnan, Ken Goldberg, Kendra Byrne, Kenneth Oslund, Kento Kawaharazuka, Kevin Zhang, Keyvan Majd, Krishan Rana, Krishnan Srinivasan, Lawrence Yunliang Chen, Lerrel Pinto, Liam Tan, Lionel Ott, Lisa Lee, Masayoshi Tomizuka, Maximilian Du, Michael Ahn, Mingtong Zhang, Mingyu Ding, Mohan Kumar Srirama, Mohit Sharma, Moo Jin Kim, Naoaki Kanazawa, Nicklas Hansen, Nicolas Heess, Nikhil J Joshi, Niko Suenderhauf, Norman Di Palo, Nur Muhammad Mahi Shafiullah, Oier Mees, Oliver Kroemer, Pannag R Sanketi, Paul Wohlhart, Peng Xu, Pierre Sermanet, Priya Sundaresan, Quan Vuong, Rafael Rafailov, Ran Tian, Ria Doshi, Roberto Martín-Martín, Russell Mendonca, Rutav Shah, Ryan Hoque, Ryan Julian, Samuel Bustamante, Sean Kirmani, Sergey Levine, Sherry Moore, Shikhar Bahl, Shivin Dass, Shuran Song, Sichun Xu, Siddhant Haldar, Simeon Adebola, Simon Guist, Soroush Nasiriany, Stefan Schaal, Stefan Welker, Stephen Tian, Sudeep Dasari, Suneel Belkhale, Takayuki Osa, Tatsuya Harada, Tatsuya Matsushima, Ted Xiao, Tianhe Yu, Tianli Ding, Todor Davchev, Tony Z. Zhao, Travis Armstrong, Trevor Darrell, Vidhi Jain, Vincent Vanhoucke, Wei Zhan, Wenxuan Zhou, Wolfram Burgard, Xi Chen, Xiaolong Wang, Xinghao Zhu, Xuanlin Li, Yao Lu, Yevgen Chebotar, Yifan Zhou, Yifeng Zhu, Ying Xu, Yixuan Wang, Yonatan Bisk, Yoonyoung Cho, Youngwoon Lee, Yuchen Cui, Yueh hua Wu, Yujin Tang, Yuke Zhu, Yunzhu Li, Yusuke Iwasawa, Yutaka Matsuo, Zhuo Xu, and Zichen Jeff Cui · 2024
Closest in time.
Openvla: An open-source vision-language-action model, 2024
Moo Jin Kim, Karl Pertsch, Siddharth Karamcheti, Ted Xiao, Ashwin Balakrishna, Suraj Nair, Rafael Rafailov, Ethan Foster, Grace Lam, Pannag Sanketi, Quan Vuong, Thomas Kollar, Benjamin Burchfiel, Russ Tedrake, Dorsa Sadigh, Sergey Levine, Percy Liang, and Chelsea Finn · 2024
Closest in time.
Serl: A software suite for sample-efficient robotic reinforcement learning
Jianlan Luo, Zheyuan Hu, Charles Xu, You Liang Tan, Jacob Berg, Archit Sharma, Stefan Schaal, Chelsea Finn, Abhishek Gupta, and Sergey Levine · 2024
Closest in time.
Multistage cable routing through hierarchical imitation learning
Jianlan Luo, Charles Xu, Xinyang Geng, Gilbert Feng, Kuan Fang, Liam Tan, Stefan Schaal, and Sergey Levine · 2024
Closest in time.
Octo: An open-source generalist robot policy, 2024
Octo Model Team, Dibya Ghosh, Homer Walke, Karl Pertsch, Kevin Black, Oier Mees, Sudeep Dasari, Joey Hejna, Tobias Kreiman, Charles Xu, Jianlan Luo, You Liang Tan, Lawrence Yunliang Chen, Pannag Sanketi, Quan Vuong, Ted Xiao, Dorsa Sadigh, Chelsea Finn, and Sergey Levine · 2024
Closest in time.
A review of the high-mix, low-volume manufacturing industry
Zhi Lon Gan, Siti Nurmaya Musa, and Hwa Jen Yap · 2076
Closest in time.