UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spaces

Challenging the egocentric view of coordinated perceiving, acting, and knowing

Michael J Richardson, Kerry L Marsh, and RC Schmidt. 2010 · 2010

Earlier work this paper cites.

Collecting highly parallel data for paraphrase evaluation

David Chen and William B Dolan. 2011 · 2011

Earlier work this paper cites.

Multi-target detection and tracking from a single camera in unmanned aerial vehicles (uavs)

Jing Li, Dong Hye Ye, Timothy Chung, Mathias Kolsch, Juan Wachs, and Charles Bouman. 2016 · 2016

Earlier work this paper cites.

Mobile three-dimensional maps for wayfinding in large and complex buildings: Empirical comparison of first-person versus third-person perspective

Stefano Burigat, Luca Chittaro, and Riccardo Sioni. 2017 · 2017

Earlier work this paper cites.

Video question answering via gradually refined attention over appearance and motion

Dejing Xu, Zhou Zhao, Jun Xiao, Fei Wu, Hanwang Zhang, Xiangnan He, and Yueting Zhuang. 2017 · 2017

Earlier work this paper cites.

Embodied cognition

Lawrence Shapiro. 2019 · 2019

Earlier work this paper cites.

Object goal navigation using goal-oriented semantic exploration

Devendra Singh Chaplot, Dhiraj Prakashchand Gandhi, Abhinav Gupta, and Russ R Salakhutdinov. 2020 · 2020

Earlier work this paper cites.

Vision-language navigation with self-supervised auxiliary reasoning tasks

Fengda Zhu, Yi Zhu, Xiaojun Chang, and Xiaodan Liang. 2020 · 2020

Earlier work this paper cites.

Embodied intelligence via learning and evolution

Agrim Gupta, Silvio Savarese, Surya Ganguli, and Li Fei-Fei. 2021 · 2021

Earlier work this paper cites.

Lora: Low-rank adaptation of large language models

Original

Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021 · 2021

Earlier work this paper cites.

Human-centric spatio-temporal video grounding with visual transformers

Zongheng Tang, Yue Liao, Si Liu, Guanbin Li, Xiaojie Jin, Hongxu Jiang, Qian Yu, and Dong Xu. 2021 · 2021

Earlier work this paper cites.

Detection, tracking, and counting meets drones in crowds: A benchmark

Longyin Wen, Dawei Du, Pengfei Zhu, Qinghua Hu, Qilong Wang, Liefeng Bo, and Siwei Lyu. 2021 · 2021

Earlier work this paper cites.

Detection and tracking meet drones challenge

Pengfei Zhu, Longyin Wen, Dawei Du, Xiao Bian, Heng Fan, Qinghua Hu, and Haibin Ling. 2021 · 2021

Earlier work this paper cites.

Minedojo: Building open-ended embodied agents with internet-scale knowledge

Linxi Fan, Guanzhi Wang, Yunfan Jiang, Ajay Mandlekar, Yuncong Yang, Haoyi Zhu, Andrew Tang, De-An Huang, Yuke Zhu, and Anima Anandkumar. 2022 · 2022

Earlier work this paper cites.

Ego4d: Around the world in 3,000 hours of egocentric video

Kristen Grauman, Andrew Westbury, Eugene Byrne, Zachary Chavis, Antonino Furnari, Rohit Girdhar, Jackson Hamburger, Hao Jiang, Miao Liu, Xingyu Liu, et al. 2022 · 2022

Earlier work this paper cites.

R3m: A universal visual representation for robot manipulation

Original

Suraj Nair, Aravind Rajeswaran, Vikash Kumar, Chelsea Finn, and Abhinav Gupta. 2022 · 2022

Earlier work this paper cites.

An embodied generalist agent in 3d world

Original

Jiangyong Huang, Silong Yong, Xiaojian Ma, Xiongkun Linghu, Puhao Li, Yan Wang, Qing Li, Song-Chun Zhu, Baoxiong Jia, and Siyuan Huang. 2023 · 2023

Earlier work this paper cites.

Large multimodal models: Notes on cvpr 2023 tutorial

Original

Chunyuan Li. 2023 · 2023

Earlier work this paper cites.

Aerialvln: Vision-and-language navigation for uavs

Shubo Liu, Hongsheng Zhang, Yuankai Qi, Peng Wang, Yanning Zhang, and Qi Wu. 2023 · 2023

Earlier work this paper cites.

Where are we in the search for an artificial visual cortex for embodied intelligence?

Arjun Majumdar, Karmesh Yadav, Sergio Arnaud, Jason Ma, Claire Chen, Sneha Silwal, Aryan Jain, Vincent-Pierre Berges, Tingfan Wu, Jay Vakil, et al. 2023 · 2023

Cited alongside, same era.

Egoschema: A diagnostic benchmark for very long-form video language understanding

Karttikeya Mangalam, Raiymbek Akshulakov, and Jitendra Malik. 2023 · 2023

Cited alongside, same era.

Building a cognitive science of human variation: Individual differences in spatial navigation

Nora S Newcombe, Mary Hegarty, and David Uttal. 2023 · 2023

Cited alongside, same era.

Scene graph contrastive learning for embodied navigation

Kunal Pratap Singh, Jordi Salvador, Luca Weihs, and Aniruddha Kembhavi. 2023 · 2023

Cited alongside, same era.

Llm-planner: Few-shot grounded planning for embodied agents with large language models

Chan Hee Song, Jiaman Wu, Clayton Washington, Brian M Sadler, Wei-Lun Chao, and Yu Su. 2023 · 2023

Cited alongside, same era.

Videoinsta: Zero-shot long video understanding via informative spatial-temporal reasoning with llms

Original

Ruotong Liao, Max Erler, Huiyu Wang, Guangyao Zhai, Gengyuan Zhang, Yunpu Ma, and Volker Tresp. 2024 · 2024

Later among the works it cites.

Lingoqa: Visual question answering for autonomous driving

Ana-Maria Marcu, Long Chen, Jan Hünermann, Alice Karnsund, Benoit Hanotte, Prajwal Chidananda, Saurabh Nair, Vijay Badrinarayanan, Alex Kendall, Jamie Shotton, et al. 2024 · 2024

Later among the works it cites.

Does spatial cognition emerge in frontier models?

Original

Santhosh Kumar Ramakrishnan, Erik Wijmans, Philipp Kraehenbuehl, and Vladlen Koltun. 2024 · 2024

Later among the works it cites.

Exploring efficient foundational multi-modal models for video summarization

Original

Karan Samel, Apoorva Beedu, Nitish Sontakke, and Irfan Essa. 2024 · 2024

Later among the works it cites.