Language and Sketching: An LLM-driven Interactive Multimodal Multitask Robot Navigation Framework

D. Helbing and P. Molnar, “Social force model for pedestrian dynamics,” Physical review E , vol. 51, no. 5, p. 4282, 1995

1995

Earlier work this paper cites.

M. Skubic, C. Bailey, and G. Chronis, “A sketch interface for mobile robots,” in SMC’03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme-System Security and Assurance (Cat. No. 03CH37483) , vol. 1. IEEE, 2003, pp. 919–924

2003

Earlier work this paper cites.

K. Morioka, J.-H. Lee, and H. Hashimoto, “Human-following mobile robot in a distributed intelligent sensor network,” IEEE Transactions on Industrial Electronics , vol. 51, no. 1, pp. 229–237, 2004

2004

Earlier work this paper cites.

M. Skubic, D. Anderson, S. Blisard, D. Perzanowski, and A. Schultz, “Using a hand-drawn sketch to control a team of robots,” Autonomous Robots , vol. 22, pp. 399–410, 2007

2007

Earlier work this paper cites.

J. Van Den Berg, S. J. Guy, M. Lin, and D. Manocha, “Reciprocal n-body collision avoidance,” in Robotics Research: The 14th International Symposium ISRR . Springer, 2011, pp. 3–19

2011

Earlier work this paper cites.

F. Boniardi, A. Valada, W. Burgard, and G. D. Tipaldi, “Autonomous indoor robot navigation using a sketch interface for drawing maps and routes,” in 2016 IEEE International Conference on Robotics and Automation (ICRA) . IEEE, 2016, pp. 2896–2901

2016

Earlier work this paper cites.

M. Gupta, S. Kumar, L. Behera, and V. K. Subramanian, “A novel vision-based tracking algorithm for a human-following mobile robot,” IEEE Transactions on Systems, Man, and Cybernetics: Systems , vol. 47, no. 7, pp. 1415–1427, 2016

2016

Earlier work this paper cites.

Q. Xiao, F. Sun, R. Ge, K. Chen, and B. Wang, “Human tracking and following of mobile robot with a laser scanner,” in 2017 2nd International Conference on Advanced Robotics and Mechatronics (ICARM) . IEEE, 2017, pp. 675–680

2017

Earlier work this paper cites.

W. Chi, J. Wang, and M. Q.-H. Meng, “A gait recognition method for human following in service robots,” IEEE Transactions on Systems, Man, and Cybernetics: Systems , vol. 48, no. 9, pp. 1429–1440, 2017

2017

Earlier work this paper cites.

A. Majumdar, A. Shrivastava, S. Lee, P. Anderson, D. Parikh, and D. Batra, “Improving vision-and-language navigation with image-text pairs from the web,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part VI 16 . Springer, 2020, pp. 259–274

2020

Earlier work this paper cites.

L. Kästner, C. Marx, and J. Lambrecht, “Deep-reinforcement-learning-based semantic navigation of mobile robots in dynamic environments,” in 2020 IEEE 16th International Conference on Automation Science and Engineering (CASE) . IEEE, 2020, pp. 1110–1115

2020

Cited alongside, same era.

J. Jin, N. M. Nguyen, N. Sakib, D. Graves, H. Yao, and M. Jagersand, “Mapless navigation among dynamics with social-safety-awareness: a reinforcement learning approach from 2d laser scans,” in 2020 IEEE international conference on robotics and automation (ICRA) . IEEE, 2020, pp. 6979–6985

2020

Cited alongside, same era.

R. Algabri and M.-T. Choi, “Deep-learning-based indoor human following of mobile robot using color feature,” Sensors , vol. 20, no. 9, p. 2699, 2020

2020

Cited alongside, same era.

Y. Hong, Q. Wu, Y. Qi, C. Rodriguez-Opazo, and S. Gould, “Vln bert: A recurrent vision-and-language bert for navigation,” in Proceedings of the IEEE/CVF conference on Computer Vision and Pattern Recognition , 2021, pp. 1643–1653

Y. Jiang, A. Gupta, Z. Zhang, G. Wang, Y. Dou, Y. Chen, L. Fei-Fei, A. Anandkumar, Y. Zhu, and L. Fan, “Vima: General robot manipulation with multimodal prompts,” arXiv preprint arXiv:2210.03094 , 2022

Original

2022

Later among the works it cites.

Q. Qiu, S. Yao, J. Wang, J. Ma, G. Chen, and J. Ji, “Learning to socially navigate in pedestrian-rich environments with interaction capacity,” in 2022 International Conference on Robotics and Automation (ICRA) . IEEE, 2022, pp. 279–285

2022

Later among the works it cites.

A. Bucker, L. Figueredo, S. Haddadin, A. Kapoor, S. Ma, S. Vemprala, and R. Bonatti, “Latte: Language trajectory transformer,” in 2023 IEEE International Conference on Robotics and Automation (ICRA) . IEEE, 2023, pp. 7287–7294

2023

Closest in time.

Y. Cui, S. Karamcheti, R. Palleti, N. Shivakumar, P. Liang, and D. Sadigh, “No, to the right: Online language corrections for robotic manipulation via shared autonomy,” in Proceedings of the 2023 ACM/IEEE International Conference on Human-Robot Interaction , 2023, pp. 93–101