Social-LLaVA: Enhancing Robot Navigation through Human-Language Reasoning in Social Spaces

D. Helbing and P. Molnar, “Social force model for pedestrian dynamics,” Physical review E , vol. 51, no. 5, p. 4282, 1995

1995

Earlier work this paper cites.

D. Marr, Vision : a computational investigation into the human representation and processing of visual information . Cambridge, Mass: The MIT Press, Jul. 2010

2010

Earlier work this paper cites.

J. Van Den Berg, S. J. Guy, M. Lin, and D. Manocha, “Reciprocal n-body collision avoidance,” in Robotics Research: The 14th International Symposium ISRR . Springer, 2011, pp. 3–19

2011

Earlier work this paper cites.

J. Mumm and B. Mutlu, “Human-robot proxemics: physical and psychological distancing in human-robot interaction,” in Proceedings of the 6th international conference on Human-robot interaction , 2011, pp. 331–338

2011

Earlier work this paper cites.

G. Ferrer, A. Garrell, and A. Sanfeliu, “Social-aware robot navigation in urban environments,” in 2013 European Conference on Mobile Robots . IEEE, 2013, pp. 331–336

2013

Earlier work this paper cites.

G. Ferrer, A. Garrell, and A. Sanfeliu, “Robot companion: A social-force based approach with human awareness-navigation in crowded environments,” in 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems . IEEE, 2013, pp. 1688–1694

2013

Earlier work this paper cites.

J. A. Groeger, Understanding driving: Applying cognitive psychology to a complex everyday task . Routledge, 2013

2013

Earlier work this paper cites.

T.-Y. Lin, M. Maire, S. Belongie, L. Bourdev, R. Girshick, J. Hays, P. Perona, D. Ramanan, C. L. Zitnick, and P. Dollár, “Microsoft coco: Common objects in context,” 2015. [Online]. Available: https://arxiv.org/abs/1405.0312

Original

2015

Earlier work this paper cites.

K. Charalampous, I. Kostavelis, and A. Gasteratos, “Robot navigation in large-scale social maps: An action recognition approach,” Expert Systems with Applications , vol. 66, pp. 261–273, 2016

2016

Earlier work this paper cites.

P. Liu, D. F. Glas, T. Kanda, and H. Ishiguro, “Data-driven hri: Learning social behaviors by example from human–human interaction,” IEEE Transactions on Robotics , vol. 32, no. 4, pp. 988–1008, 2016

2016

Earlier work this paper cites.

X. Xiao, B. Liu, G. Warnell, J. Fink, and P. Stone, “Appld: Adaptive planner parameter learning from demonstration,” IEEE Robotics and Automation Letters , vol. 5, no. 3, pp. 4541–4547, 2020

2020

Earlier work this paper cites.

M. H. Nazeri and M. Bohlouli, “Exploring reflective limitation of behavior cloning in autonomous vehicles,” in 2021 IEEE International Conference on Data Mining (ICDM) , 2021, pp. 1252–1257

2021

Earlier work this paper cites.

E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen, “Lora: Low-rank adaptation of large language models,” 2021. [Online]. Available: https://arxiv.org/abs/2106.09685

Original

2021

Earlier work this paper cites.

H. Karnan, A. Nair, X. Xiao, G. Warnell, S. Pirk, A. Toshev, J. Hart, J. Biswas, and P. Stone, “Socially compliant navigation dataset (scand): A large-scale dataset of demonstrations for social navigation,” IEEE Robotics and Automation Letters , 2022

2022

Earlier work this paper cites.

S. Pirk, E. Lee, X. Xiao, L. Takayama, A. Francis, and A. Toshev, “A protocol for validating social navigation policies,” arXiv preprint arXiv:2204.05443 , 2022

Original

2022

Earlier work this paper cites.

X. Xiao, T. Zhang, K. M. Choromanski, T.-W. E. Lee, A. Francis, J. Varley, S. Tu, S. Singh, P. Xu, F. Xia, S. M. Persson, L. Takayama, R. Frostig, J. Tan, C. Parada, and V. Sindhwani, “Learning model predictive controllers with real-time attention for real-world navigation,” in Conference on robot learning . PMLR, 2022

2022

Earlier work this paper cites.

J. Gu, E. Stefani, Q. Wu, J. Thomason, and X. Wang, “Vision-and-language navigation: A survey of tasks, methods, and future directions,” in Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) . Association for Computational Linguistics, 2022. [Online]. Available: http://dx.doi.org/10.18653/v1/2022.acl-long.524

2022

Cited alongside, same era.

C. Mavrogiannis, F. Baldini, A. Wang, D. Zhao, P. Trautman, A. Steinfeld, and J. Oh, “Core challenges of social robot navigation: A survey,” ACM Transactions on Human-Robot Interaction , vol. 12, no. 3, pp. 1–39, 2023

2023

Cited alongside, same era.

D. M. Nguyen, M. Nazeri, A. Payandeh, A. Datar, and X. Xiao, “Toward human-like social robot navigation: A large-scale, multi-modal, social human navigation dataset,” in IEEE/RSJ International Conference on Intelligent Robots and Systems , 2023, pp. 7442–7447

2023

Cited alongside, same era.

N. Hirose, D. Shah, A. Sridhar, and S. Levine, “Sacson: Scalable autonomous control for social navigation,” IEEE Robotics and Automation Letters , 2023

R. Mirsky, X. Xiao, J. Hart, and P. Stone, “Conflict avoidance in social navigation—a survey,” ACM Transactions on Human-Robot Interaction , vol. 13, no. 1, pp. 1–36, 2024

2024

Closest in time.

A. Francis, C. Pérez-d’Arpino, C. Li, F. Xia, A. Alahi, R. Alami, A. Bera, A. Biswas, J. Biswas, R. Chandra et al. , “Principles and guidelines for evaluating social robot navigation algorithms,” ACM Transactions on Human-Robot Interaction , 2024

2024

Closest in time.

M. Nazeri, J. Wang, A. Payandeh, and X. Xiao, “Vanp: Learning where to see for navigation with self-supervised vision-action pre-training,” 2024. [Online]. Available: https://arxiv.org/abs/2403.08109

Original

2024

Closest in time.

A. H. Raj, Z. Hu, H. Karnan, R. Chandra, A. Payandeh, L. Mao, P. Stone, J. Biswas, and X. Xiao, “Targeted learning: A hybrid approach to social robot navigation,” in IEEE International Conference on Robotics and Automation , 2024

2024

Closest in time.