Pragmatic Embodied Spoken Instruction Following in Human-Robot Collaboration with Theory of Mind · Around

Fetching the paper…

Pragmatic Embodied Spoken Instruction Following in Human-Robot Collaboration with Theory of Mind · Around

Built on

P. E. Hart, N. J. Nilsson, and B. Raphael, “A formal basis for the heuristic determination of minimum cost paths,” IEEE transactions on Systems Science and Cybernetics , vol. 4, no. 2, pp. 100–107, 1968
1968
Earlier work this paper cites.
M. Tomasello, Origins of human communication . MIT press, 2010
2010
Earlier work this paper cites.
S. Devin and R. Alami, “An implemented theory of mind to improve human-robot shared plans execution,” in 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI) . IEEE, 2016, pp. 319–326
2016
Earlier work this paper cites.
D. Hadfield-Menell, S. J. Russell, P. Abbeel, and A. Dragan, “Cooperative inverse reinforcement learning,” in Advances in Neural Information Processing Systems , 2016, pp. 3909–3917
2016
Earlier work this paper cites.
J. F. Fisac, M. A. Gates, J. B. Hamrick, C. Liu, D. Hadfield-Menell, M. Palaniappan, D. Malik, S. S. Sastry, T. L. Griffiths, and A. D. Dragan, “Pragmatic-pedagogic value alignment,” in Robotics research: the 18th international symposium Isrr . Springer, 2019, pp. 49–57
2019
Earlier work this paper cites.
C. K. Reddy, E. Beyrami, J. Pool, R. Cutler, S. Srinivasan, and J. Gehrke, “A scalable noisy speech dataset and online subjective test framework,” arXiv preprint arXiv:1909.08050 , 2019
Original
2019
Earlier work this paper cites.
X. Puig, T. Shu, S. Li, Z. Wang, Y.-H. Liao, J. B. Tenenbaum, S. Fidler, and A. Torralba, “Watch-and-help: A challenge for social perception and human-ai collaboration,” arXiv preprint arXiv:2010.09890 , 2020
Original
2020
Earlier work this paper cites.
V. Blukis, R. A. Knepper, and Y. Artzi, “Few-shot object grounding and mapping for natural language robot instruction following,” arXiv preprint arXiv:2011.07384 , 2020
Original
2020
Earlier work this paper cites.
T. Zhi-Xuan, J. Mann, T. Silver, J. Tenenbaum, and V. Mansinghka, “Online bayesian goal inference for boundedly rational planning agents,” Advances in Neural Information Processing Systems , vol. 33, 2020
2020
Earlier work this paper cites.
S. Y. Min, D. S. Chaplot, P. Ravikumar, Y. Bisk, and R. Salakhutdinov, “Film: Following instructions in language with modular methods,” arXiv preprint arXiv:2110.07342 , 2021
Original
2021
Earlier work this paper cites.
T. Shu, A. Bhandwaldar, C. Gan, K. Smith, S. Liu, D. Gutfreund, E. Spelke, J. Tenenbaum, and T. Ullman, “Agent: A benchmark for core psychological reasoning,” in International conference on machine learning . PMLR, 2021, pp. 9614–9625
2021
Earlier work this paper cites.
H. Liu, L. Lee, K. Lee, and P. Abbeel, “Instruction-following agents with jointly pre-trained vision-language models,” 2022
2022
Earlier work this paper cites.

Similar

B. Ichter, A. Brohan, Y. Chebotar, C. Finn, K. Hausman, . …, and C. Kelly, “Do as i can, not as i say: Grounding language in robotic affordances,” in Proceedings of The 6th Conference on Robot Learning , ser. Proceedings of Machine Learning Research, K. Liu, D. Kulic, and J. Ichnowski, Eds., vol. 205. PMLR, 14–18 Dec 2023, pp. 287–318
2023
Cited alongside, same era.
H. Zhang, W. Du, J. Shan, Q. Zhou, Y. Du, J. B. Tenenbaum, T. Shu, and C. Gan, “Building cooperative embodied agents modularly with large language models,” arXiv preprint arXiv:2307.02485 , 2023
Original
2023
Cited alongside, same era.
G. Li, H. Hammoud, H. Itani, D. Khizbullin, and B. Ghanem, “Camel: Communicative agents for" mind" exploration of large language model society,” Advances in Neural Information Processing Systems , vol. 36, pp. 51 991–52 008, 2023
2023
Cited alongside, same era.
G. Wang, Y. Xie, Y. Jiang, A. Mandlekar, C. Xiao, Y. Zhu, L. Fan, and A. Anandkumar, “Voyager: An open-ended embodied agent with large language models,” arXiv preprint arXiv:2305.16291 , 2023

Then

Y. Long, W. Cai, H. Wang, G. Zhan, and H. Dong, “Instructnav: Zero-shot system for generic instruction navigation in unexplored environment,” arXiv preprint arXiv:2406.04882 , 2024
Original
2024
Closest in time.
J. X. Liu, A. Shah, G. Konidaris, S. Tellex, and D. Paulius, “Lang2LTL-2: Grounding spatiotemporal navigation commands using large language and vision-language models,” in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2024
2024
Closest in time.
V. Cohen, J. X. Liu, R. Mooney, S. Tellex, and D. Watkins, “A survey of robotic language grounding: Tradeoffs between symbols and embeddings,” in International Joint Conference on Artificial Intelligence , 2024
2024
Closest in time.
T. Zhi-Xuan, L. Ying, V. Mansinghka, and J. B. Tenenbaum, “Pragmatic instruction following and goal assistance via cooperative language-guided inverse planning,” arXiv preprint arXiv:2402.17930 , 2024
Original
2024
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…