2021

Assistive Tele-op: Leveraging Transformers to Collect Robotic Task Demonstrations

Clever, Henry M., Handa, Ankur, Mazhar, Hammad et al.

Understand

Sharing autonomy between robots and human operators could facilitate data collection of robotic task demonstrations to continuously improve learned models.

Yet, the means to communicate intent and reason about the future are disparate between humans and robots.
We present Assistive Tele-op, a virtual reality (VR) system for collecting robot task demonstrations that displays an autonomous trajectory forecast to communicate the robot's intent.
As the robot moves, the user can switch between autonomous and manual control when desired.

Built on

A survey of robot learning from demonstration
Brenna D Argall, Sonia Chernova, Manuela Veloso, and Brett Browning · 2009
Earlier work this paper cites.
A reduction of imitation learning and structured prediction to no-regret online learning
Stéphane Ross, Geoffrey Gordon, and Drew Bagnell · 2011
Earlier work this paper cites.
Mujoco: A physics engine for model-based control
Emanuel Todorov, Tom Erez, and Yuval Tassa · 2012
Earlier work this paper cites.
Learning neural network policies with guided policy search under unknown dynamics
Sergey Levine and Pieter Abbeel · 2014
Earlier work this paper cites.
Continuous control with deep reinforcement learning
Original
Timothy P Lillicrap, Jonathan J Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, and Daan Wierstra · 2015
Earlier work this paper cites.
Human-in-the-loop optimization of shared autonomy in assistive robotics
Deepak Gopinath, Siddarth Jain, and Brenna D Argall · 2016
Earlier work this paper cites.
C-learn: Learning geometric constraints from demonstrations for multi-step manipulation in shared autonomy
Claudia Pérez-D’Arpino and Julie A Shah · 2017
Earlier work this paper cites.
Proximal policy optimization algorithms
Original
John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Earlier work this paper cites.
Applied optimal control: optimization, estimation, and control
Arthur E Bryson and Yu-Chi Ho · 2018
Earlier work this paper cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
Original
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2018
Earlier work this paper cites.

Similar

Recurrent world models facilitate policy evolution
Original
David Ha and Jürgen Schmidhuber · 2018
Cited alongside, same era.
Roboturk: A crowdsourcing platform for robotic skill learning through imitation
Ajay Mandlekar, Yuke Zhu, Animesh Garg, Jonathan Booher, Max Spero, Albert Tung, Julian Gao, John Emmons, Anchit Gupta, Emre Orbay, et al · 2018
Cited alongside, same era.
Riemannian motion policies
Original
Nathan D Ratliff, Jan Issac, Daniel Kappler, Stan Birchfield, and Dieter Fox · 2018
Cited alongside, same era.
Shared autonomy via deep reinforcement learning
Original
Siddharth Reddy, Anca D Dragan, and Sergey Levine · 2018
Cited alongside, same era.
Deep imitation learning for complex manipulation tasks from virtual reality teleoperation
Tianhao Zhang, Zoe McCarthy, Owen Jow, Dennis Lee, Xi Chen, Ken Goldberg, and Pieter Abbeel · 2018
Cited alongside, same era.
Closing the sim-to-real loop: Adapting simulation randomization with real world experience
Yevgen Chebotar, Ankur Handa, Viktor Makoviychuk, Miles Macklin, Jan Issac, Nathan Ratliff, and Dieter Fox · 2019
Cited alongside, same era.
In-home and remote use of robotic body surrogates by people with profound motor deficits
Phillip M Grice and Charles C Kemp · 2019
Cited alongside, same era.
Learning from demonstration for semi-autonomous teleoperation
Ioannis Havoutis and Sylvain Calinon · 2019
Cited alongside, same era.
Variable impedance control in end-effector space: An action space for reinforcement learning in contact-rich tasks
Roberto Martín-Martín, Michelle A Lee, Rachel Gardner, Silvio Savarese, Jeannette Bohg, and Animesh Garg · 2019
Cited alongside, same era.
Assistive vr gym: Interactions with real people to improve virtual assistive robots
Zackory Erickson, Yijun Gu, and Charles C Kemp · 2020
Cited alongside, same era.
Online replanning in belief space for partially observable task and motion problems
Caelan Reed Garrett, Chris Paxton, Tomás Lozano-Pérez, Leslie Pack Kaelbling, and Dieter Fox · 2020
Cited alongside, same era.

Then

Shared autonomy with learned latent actions
Original
Hong Jun Jeon, Dylan P Losey, and Dorsa Sadigh · 2020
Later among the works it cites.
Understanding multi-modal perception using behavioral cloning for peg-in-a-hole insertion tasks
Original
Yifang Liu, Diego Romeres, Devesh K Jha, and Daniel Nikovski · 2020
Later among the works it cites.
Experimental assessment of human-robot teaming for multi-step remote manipulation with expert operators
Original
Claudia Pérez-D’Arpino, Rebecca P Khurshid, and Julie A Shah · 2020
Later among the works it cites.
Transporter networks: Rearranging the visual world for robotic manipulation
Original
Andy Zeng, Pete Florence, Jonathan Tompson, Stefan Welker, Jonathan Chien, Maria Attarian, Travis Armstrong, Ivan Krasin, Dan Duong, Vikas Sindhwani, et al · 2020
Later among the works it cites.
Transferring dexterous manipulation from gpu simulation to a remote real-world trifinger
Original
Arthur Allshire, Mayank Mittal, Varun Lodaya, Viktor Makoviychuk, Denys Makoviichuk, Felix Widmaier, Manuel Wüthrich, Stefan Bauer, Ankur Handa, and Animesh Garg · 2021
Closest in time.
Decision transformer: Reinforcement learning via sequence modeling
Original
Lili Chen, Kevin Lu, Aravind Rajeswaran, Kimin Lee, Aditya Grover, Michael Laskin, Pieter Abbeel, Aravind Srinivas, and Igor Mordatch · 2021
Closest in time.
Reinforcement learning as one big sequence modeling problem
Original
Michael Janner, Qiyang Li, and Sergey Levine · 2021
Closest in time.
Omniverse multi-GPU real-time simulation and collaboration platform
NVIDIA · 2021
Closest in time.
Train short, test long: Attention with linear biases enables input length extrapolation
Ofir Press, Noah A. Smith, and Mike Lewis · 2021
Closest in time.
The devil is in the detail: Simple tricks improve systematic generalization of transformers
Original
Jürgen Schmidhuber Róbert Csordás, Kazuki Irie · 2021
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…