Fetching the paper…
Reading the bibliography…
We introduce Language-Informed Latent Actions (LILA), a framework for learning natural language interfaces in the context of human-robot collaboration.
A unified approach for motion and force control of robot manipulators: The operational space formulation
O. Khatib · 1987
Earlier work this paper cites.
Relative end-effector control using cartesian position based visual servoing
W. J. Wilson, C. W. Hulls, and G. S. Bell · 1996
Earlier work this paper cites.
Hand posture subspaces for dexterous robotic grasping
M. T. Ciocarlie and P. K. Allen · 2009
Earlier work this paper cites.
Toward understanding natural language directions
T. Kollar, S. Tellex, D. Roy, and N. Roy · 2010
Earlier work this paper cites.
Understanding natural language commands for robotic navigation and mobile manipulation
S. Tellex, T. Kollar, S. Dickerson, M. R. Walter, A. G. Banerjee, S. J. Teller, and N. Roy · 2011
Earlier work this paper cites.
A reduction of imitation learning and structured prediction to no-regret online learning
S. Ross, G. Gordon, and A. Bagnell · 2011
Earlier work this paper cites.
Learning to parse natural language commands to a robot control system
C. Matuszek, E. Herbst, L. Zettlemoyer, and D. Fox · 2012
Earlier work this paper cites.
A policy-blending formalism for shared control
A. D. Dragan and S. S. Srinivasa · 2013
Earlier work this paper cites.
Weakly supervised learning of semantic parsers for mapping instructions to actions
Y. Artzi and L. Zettlemoyer · 2013
Earlier work this paper cites.
Imitation learning for natural language direction following through unknown environments
F. Duvallet, T. Kollar, and A. Stentz · 2013
Earlier work this paper cites.
Toward interactive grounded language acqusition
T. Kollar, J. Krishnamurthy, and G. P. Strimel · 2013
Earlier work this paper cites.
Interpreting situated dialogue utterances: an update model that uses speech, gaze, and gesture information
C. Kennington, S. Kousidis, and D. Schlangen · 2013
Earlier work this paper cites.
Learning from unscripted deictic gesture and language for human-robot interactions
C. Matuszek, L. Bo, L. Zettlemoyer, and D. Fox · 2014
Earlier work this paper cites.
Grounding English commands to reward functions
J. MacGlashan, M. Babes-Vroman, M. desJardins, M. Littman, S. Muresan, S. Squire, S. Tellex, D. Arumugam, and L. Yang · 2015
Earlier work this paper cites.
Assistive teleoperation of robot arms via automatic time-optimal mode switching
L. V. Herlant, R. M. Holladay, and S. S. Srinivasa · 2016
Earlier work this paper cites.
Human-in-the-loop optimization of shared autonomy in assistive robotics
D. Gopinath, S. Jain, and B. D. Argall · 2016
Earlier work this paper cites.
Tutorial on variational autoencoders
C. Doersch · 2016
Earlier work this paper cites.
Interpreting multimodal referring expressions in real time
D. Whitney, M. Eldon, J. G. Oberlin, and S. Tellex · 2016
Earlier work this paper cites.
Accurately and efficiently interpreting human-robot instructions of varying granularities
D. Arumugam, S. Karamcheti, N. Gopalan, L. L. S. Wong, and S. Tellex · 2017
Earlier work this paper cites.
Grounded language learning in a simulated 3d world
K. M. Hermann, F. Hill, S. Green, F. Wang, R. Faulkner, H. Soyer, D. Szepesvari, W. Czarnecki, M. Jaderberg, D. Teplyashin, M. Wainwright, C. Apps, D. Hassabis, and P. Blunsom · 2017
Earlier work this paper cites.
A tale of two draggns: A hybrid approach for interpreting action-oriented and goal-oriented instructions
S. Karamcheti, E. C. Williams, D. Arumugam, M. Rhee, N. Gopalan, L. L. S. Wong, and S. Tellex · 2017
Earlier work this paper cites.
Naturalizing a programming language via interactive learning
S. I. Wang, S. Ginn, P. Liang, and C. D. Manning · 2017
Cited alongside, same era.
Dart: Noise injection for robust imitation learning
M. Laskey, J. N. Lee, R. Fox, A. Dragan, and K. Goldberg · 2017
Cited alongside, same era.
Americans With Disabilities: 2014
D. M. Taylor · 2018
Cited alongside, same era.
Autonomy in rehabilitation robotics: an intersection
B. D. Argall · 2018
Cited alongside, same era.
Shared autonomy via hindsight optimization for teleoperation and teaming
S. Javdani, H. Admoni, S. Pellegrinelli, S. S. Srinivasa, and J. A. Bagnell · 2018
Cited alongside, same era.
Bottom-up and top-down attention for image captioning and visual question answering
P. Anderson, X. He, C. Buehler, D. Teney, M. Johnson, S. Gould, and L. Zhang · 2018
Cited alongside, same era.
Guiding policies with language via meta-learning
J. D. Co-Reyes, A. Gupta, S. Sanjeev, N. Altieri, J. DeNero, P. Abbeel, and S. Levine · 2019
Later among the works it cites.
Babyai: A platform to study the sample efficiency of grounded language learning
M. Chevalier-Boisvert, D. Bahdanau, S. Lahlou, L. Willems, C. Saharia, T. H. Nguyen, and Y. Bengio · 2019
Later among the works it cites.
BERT: Pre-training of deep bidirectional transformers for language understanding
J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova · 2019
Later among the works it cites.
Exploring the limits of transfer learning with a unified text-to-text transformer
C. Raffel, N. Shazeer, A. Roberts, K. Lee, S. Narang, M. Matena, Y. Zhou, W. Li, and P. J. Liu · 2019
Later among the works it cites.
Shared autonomy with learned latent actions
H. J. Jeon, D. P. Losey, and D. Sadigh · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Grounded language learning: Where robotics and NLP meet
C. Matuszek · 2018
Cited alongside, same era.
Harmonic: A multimodal dataset of assistive human-robot collaboration
B. A. Newman, R. M. Aronson, S. Srinivasa, K. Kitani, and H. Admoni · 2018
Cited alongside, same era.
Shared autonomy via deep reinforcement learning
S. Reddy, A. D. Dragan, and S. Levine · 2018
Cited alongside, same era.
Following high-level navigation instructions on a simulated quadcopter with imitation learning
V. Blukis, N. Brukhim, A. Bennett, R. A. Knepper, and Y. Artzi · 2018
Cited alongside, same era.
Gated-attention architectures for task-oriented language grounding
D. S. Chaplot, K. M. Sathyendra, R. K. Pasumarthi, D. Rajagopal, and R. Salakhutdinov · 2018
Cited alongside, same era.
Vision-and-language navigation: Interpreting visually-grounded navigation instructions in real environments
P. Anderson, Q. Wu, D. Teney, J. Bruce, M. Johnson, N. Sünderhauf, I. Reid, S. Gould, and A. van den Hengel · 2018
Cited alongside, same era.
Controlling assistive robots with learned latent actions
D. P. Losey, K. Srinivasan, A. Mandlekar, A. Garg, and D. Sadigh · 2020
Later among the works it cites.
Language-conditioned imitation learning for robot manipulation tasks
S. Stepputtis, J. Campbell, M. Phielipp, S. Lee, C. Baral, and H. B. Amor · 2020
Later among the works it cites.
Robots that use language
S. Tellex, N. Gopalan, H. Kress-Gazit, and C. Matuszek · 2020
Later among the works it cites.
Residual policy learning for shared autonomy
C. B. Schaff and M. R. Walter · 2020
Later among the works it cites.
Learning user-preferred mappings for intuitive robot control
M. Li, D. P. Losey, J. Bohg, and D. Sadigh · 2020
Later among the works it cites.
C. Lynch and P. Sermanet · 2020
Later among the works it cites.
Human instruction-following with deep reinforcement learning via transfer-learning from text
F. Hill, S. Mokra, N. Wong, and T. Harley · 2020
Later among the works it cites.
Learning adaptive language interfaces through decomposition
S. Karamcheti, D. Sadigh, and P. Liang · 2020
Later among the works it cites.
Language models are few-shot learners
T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, P. Dhariwal, A. Neelakantan, P. Shyam, G. Sastry, A. Askell, S. Agarwal, A. Herbert-Voss, G. Krueger, T. Henighan, R. Child, A. Ramesh, D. M. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. Litwin, S. Gray, B. Chess, J. Clark, C. Berner, S. McCandlish, A. Radford, I. Sutskever, and D. Amodei · 2020
Later among the works it cites.
Unnatural language processing: Bridging the gap between synthetic and natural language data
A. Marzoev, S. Madden, M. Kaashoek, M. J. Cafarella, and J. Andreas · 2020
Later among the works it cites.
Room-across-room: Multilingual vision-and-language navigation with dense spatiotemporal grounding
A. Ku, P. Anderson, R. Patel, E. Ie, and J. Baldridge · 2020
Later among the works it cites.
Alfred: A benchmark for interpreting grounded instructions for everyday tasks
M. Shridhar, J. Thomason, D. Gordon, Y. Bisk, W. Han, R. Mottaghi, L. Zettlemoyer, and D. Fox · 2020
Later among the works it cites.
Making monolingual sentence embeddings multilingual using knowledge distillation
N. Reimers and I. Gurevych · 2020
Later among the works it cites.
Learning latent actions to control assistive robots
D. P. Losey, H. J. Jeon, M. Li, K. P. Srinivasan, A. Mandlekar, A. Garg, J. Bohg, and D. Sadigh · 2021
Closest in time.
Learning visually guided latent actions for assistive teleoperation
S. Karamcheti, A. Zhai, D. P. Losey, and D. Sadigh · 2021
Closest in time.