Select2Plan: Training-Free ICL-Based Planning through VQA and Memory Retrieval

M. Savva, A. Kadian, O. Maksymets, Y. Zhao, E. Wijmans, B. Jain, J. Straub, J. Liu, V. Koltun, J. Malik, D. Parikh, and D. Batra, “Habitat: A platform for embodied ai research,” 2019. [Online]. Available: https://arxiv.org/abs/1904.01201

Original

1904

Earlier work this paper cites.

J. Carbonell and J. Stewart, “The use of mmr, diversity-based reranking for reordering documents and producing summaries,” SIGIR Forum (ACM Special Interest Group on Information Retrieval) , 06 1999

1999

Earlier work this paper cites.

X. Liang, H. Wang, W. Chen, D. Guo, and T. Liu, “Adaptive Image-Based Trajectory Tracking Control of Wheeled Mobile Robots With an Uncalibrated Fixed Camera,” IEEE Transactions on Control Systems Technology , vol. 23, no. 6, pp. 2266–2282, Nov. 2015, conference Name: IEEE Transactions on Control Systems Technology

2015

Earlier work this paper cites.

F. Xia, A. Zamir, Z.-Y. He, A. Sax, J. Malik, and S. Savarese, “Gibson env: Real-world perception for embodied agents,” 2018. [Online]. Available: https://arxiv.org/abs/1808.10654

Original

2018

Earlier work this paper cites.

W. Yang, X. Wang, A. Farhadi, A. Gupta, and R. Mottaghi, “Visual semantic navigation using scene priors,” arXiv preprint arXiv:1810.06543 , 2018

Original

2018

Earlier work this paper cites.

A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, I. Sutskever et al. , “Language models are unsupervised multitask learners,” OpenAI blog , vol. 1, no. 8, p. 9, 2019

2019

Earlier work this paper cites.

M. Wortsman, K. Ehsani, M. Rastegari, A. Farhadi, and R. Mottaghi, “Learning to learn how to learn: Self-adaptive visual navigation using meta-learning,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2019, pp. 6750–6759

2019

Earlier work this paper cites.

A. Staroverov, D. A. Yudin, I. Belkin, V. Adeshkin, Y. K. Solomentsev, and A. I. Panov, “Real-time object navigation with deep neural networks and hierarchical reinforcement learning,” IEEE Access , vol. 8, pp. 195 608–195 621, 2020

2020

Earlier work this paper cites.

X. Liang, H. Wang, Y.-H. Liu, Z. Liu, B. You, Z. Jing, and W. Chen, “Purely Image-Based Pose Stabilization of Nonholonomic Mobile Robots With a Truly Uncalibrated Overhead Camera,” IEEE Transactions on Robotics , vol. 36, no. 3, pp. 724–742, Jun. 2020, conference Name: IEEE Transactions on Robotics

2020

Earlier work this paper cites.

K. Zhou, C. Guo, and H. Zhang, “Visual navigation via reinforcement learning and relational reasoning,” in 2021 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Internet of People and Smart City Innovation , 2021, pp. 131–138

2021

Earlier work this paper cites.

E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen, “Lora: Low-rank adaptation of large language models,” arXiv preprint arXiv:2106.09685 , 2021

Original

2021

Earlier work this paper cites.

Z. Liu, Y. Lin, Y. Cao, H. Hu, Y. Wei, Z. Zhang, S. Lin, and B. Guo, “Swin transformer: Hierarchical vision transformer using shifted windows,” 2021. [Online]. Available: https://arxiv.org/abs/2103.14030

Original

2021

Earlier work this paper cites.

H. Du, X. Yu, and L. Zheng, “Vtnet: Visual transformer network for object goal navigation,” arXiv preprint arXiv:2105.09447 , 2021

Original

2021

Cited alongside, same era.

R. Fukushima, K. Ota, A. Kanezaki, Y. Sasaki, and Y. Yoshiyasu, “Object memory transformer for object goal navigation,” 2022. [Online]. Available: https://arxiv.org/abs/2203.14708

Original

2022

Cited alongside, same era.

E. Kolve, R. Mottaghi, W. Han, E. VanderBilt, L. Weihs, A. Herrasti, M. Deitke, K. Ehsani, D. Gordon, Y. Zhu, A. Kembhavi, A. Gupta, and A. Farhadi, “Ai2-thor: An interactive 3d environment for visual ai,” 2022. [Online]. Available: https://arxiv.org/abs/1712.05474

Original

2022

Cited alongside, same era.

D. Shah, A. Sridhar, A. Bhorkar, N. Hirose, and S. Levine, “Gnm: A general navigation model to drive any robot,” 2023. [Online]. Available: https://arxiv.org/abs/2210.03370

Original

2023

Cited alongside, same era.

D. S. W. Williams, M. Gadd, P. Newman, and D. D. Martini, “Masked gamma-ssl: Learning uncertainty estimation via masked image modeling,” 2024. [Online]. Available: https://arxiv.org/abs/2402.17622

Original

2024

Closest in time.

D. S. W. Williams, D. D. Martini, M. Gadd, and P. Newman, “Mitigating distributional shift in semantic segmentation via uncertainty estimation from unlabeled data,” IEEE Transactions on Robotics , vol. 40, pp. 3146–3165, 2024

2024

Closest in time.

S. Nasiriany, F. Xia, W. Yu, T. Xiao, J. Liang, I. Dasgupta, A. Xie, D. Driess, A. Wahid, Z. Xu, Q. Vuong, T. Zhang, T.-W. E. Lee, K.-H. Lee, P. Xu, S. Kirmani, Y. Zhu, A. Zeng, K. Hausman, N. Heess, C. Finn, S. Levine, and B. Ichter, “Pivot: Iterative visual prompting elicits actionable knowledge for vlms,” 2024. [Online]. Available: https://arxiv.org/abs/2402.07872

Original

2024

Closest in time.

A. J. Sathyamoorthy, K. Weerakoon, M. Elnoor, A. Zore, B. Ichter, F. Xia, J. Tan, W. Yu, and D. Manocha, “Convoi: Context-aware navigation using vision language models in outdoor and indoor environments,” arXiv preprint arXiv:2403.15637 , 2024

Original