Fetching the paper…
Reading the bibliography…
A long-term goal of AI research is to build intelligent agents that can communicate with humans in natural language, perceive the environment, and perform real-world tasks.
From language to goals: Inverse reinforcement learning for vision-based instruction following
Justin Fu, Anoop Korattikara, Sergey Levine, and Sergio Guadarrama. 2019 · 1902
Earlier work this paper cites.
The streetlearn environment and dataset
Piotr Mirowski, Andras Banki-Horvath, Keith Anderson, Denis Teplyashin, Karl Moritz Hermann, Mateusz Malinowski, Matthew Koichi Grimes, Karen Simonyan, Koray Kavukcuoglu, Andrew Zisserman, et al. 2019 · 1903
Earlier work this paper cites.
The Replica dataset: A digital replica of indoor spaces
Julian Straub, Thomas Whelan, Lingni Ma, Yufan Chen, Erik Wijmans, Simon Green, Jakob J. Engel, Raul Mur-Artal, Carl Ren, Shobhit Verma, Anton Clarkson, Mingfei Yan, Brian Budge, Yajie Yan, Xiaqing Pan, June Yon, Yuyang Zou, Kimberly Leon, Nigel Carter, Jesus Briales, Tyler Gillingham, Elias Mueggler, Luis Pesqueira, Manolis Savva, Dhruv Batra, Hauke M. Strasdat, Renzo De Nardi, Michael Goesele, Steven Lovegrove, and Richard Newcombe. 2019 · 1906
Earlier work this paper cites.
General evaluation for instruction conditioned navigation using dynamic time warping
Gabriel Ilharco, Vihan Jain, Alexander Ku, Eugene Ie, and Jason Baldridge. 2019 · 1907
Earlier work this paper cites.
Meetup! a corpus of joint activity dialogues in a visual environment
Nikolai Ilinykh, Sina Zarrieß, and David Schlangen. 2019 · 1907
Earlier work this paper cites.
Run through the streets: A new dataset and baseline models for realistic urban navigation
Tzuf Paz-Argaman and Reut Tsarfaty. 2019 · 1909
Earlier work this paper cites.
Shifting the baseline: Single modality performance on visual navigation & QA
Jesse Thomason, Daniel Gordon, and Yonatan Bisk. 2019a · 1983
Earlier work this paper cites.
Calibrating noise to sensitivity in private data analysis
Cynthia Dwork, Frank McSherry, Kobbi Nissim, and Adam Smith. 2006 · 2006
Earlier work this paper cites.
Walk the talk: Connecting language, knowledge, and action in route instructions
Matt MacMahon, Brian Stankiewicz, and Benjamin Kuipers. 2006 · 2006
Earlier work this paper cites.
Visual navigation for mobile robots: A survey
Francisco Bonin-Font, Alberto Ortiz, and Gabriel Oliver. 2008 · 2008
Earlier work this paper cites.
Curriculum learning
Yoshua Bengio, Jérôme Louradour, Ronan Collobert, and Jason Weston. 2009 · 2009
Earlier work this paper cites.
Learning to follow navigational directions
Adam Vogel and Dan Jurafsky. 2010 · 2010
Earlier work this paper cites.
Learning to interpret natural language navigation instructions from observations
David Chen and Raymond Mooney. 2011 · 2011
Earlier work this paper cites.
Understanding natural language commands for robotic navigation and mobile manipulation
Stefanie Tellex, Thomas Kollar, Steven Dickerson, Matthew Walter, Ashis Banerjee, Seth Teller, and Nicholas Roy. 2011 · 2011
Earlier work this paper cites.
Deep residual learning for image recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016 · 2016
Earlier work this paper cites.
Federated learning: Strategies for improving communication efficiency
Jakub Konečnỳ, H Brendan McMahan, Felix X Yu, Peter Richtárik, Ananda Theertha Suresh, and Dave Bacon. 2016 · 2016
Earlier work this paper cites.
Matterport3D: Learning from RGB-D data in indoor environments
Angel Chang, Angela Dai, Thomas Funkhouser, Maciej Halber, Matthias Niessner, Manolis Savva, Shuran Song, Andy Zeng, and Yinda Zhang. 2017 · 2017
Earlier work this paper cites.
AI2-THOR: An Interactive 3D Environment for Visual AI
Eric Kolve, Roozbeh Mottaghi, Winson Han, Eli VanderBilt, Luca Weihs, Alvaro Herrasti, Daniel Gordon, Yuke Zhu, Abhinav Gupta, and Ali Farhadi. 2017 · 2017
Earlier work this paper cites.
Semantic scene completion from a single depth image
Shuran Song, Fisher Yu, Andy Zeng, Angel X Chang, Manolis Savva, and Thomas Funkhouser. 2017 · 2017
Earlier work this paper cites.
Target-driven visual navigation in indoor scenes using deep reinforcement learning
Yuke Zhu, Roozbeh Mottaghi, Eric Kolve, Joseph J Lim, Abhinav Gupta, Li Fei-Fei, and Ali Farhadi. 2017 · 2017
Earlier work this paper cites.
Following high-level navigation instructions on a simulated quadcopter with imitation learning
Valts Blukis, Nataly Brukhim, Andrew Bennett, Ross A. Knepper, and Yoav Artzi. 2018 · 2018
Earlier work this paper cites.
Embodied question answering
Abhishek Das, Samyak Datta, Georgia Gkioxari, Stefan Lee, Devi Parikh, and Dhruv Batra. 2018 · 2018
Earlier work this paper cites.
Talk the walk: Navigating new york city through grounded dialogue
Harm de Vries, Kurt Shuster, Dhruv Batra, Devi Parikh, Jason Weston, and Douwe Kiela. 2018 · 2018
Earlier work this paper cites.
Speaker-follower models for vision-and-language navigation
Daniel Fried, Ronghang Hu, Volkan Cirik, Anna Rohrbach, Jacob Andreas, Louis-Philippe Morency, Taylor Berg-Kirkpatrick, Kate Saenko, Dan Klein, and Trevor Darrell. 2018 · 2018
Earlier work this paper cites.
Iqa: Visual question answering in interactive environments
Daniel Gordon, Aniruddha Kembhavi, Mohammad Rastegari, Joseph Redmon, Dieter Fox, and Ali Farhadi. 2018 · 2018
Earlier work this paper cites.
Learning to navigate in cities without a map
Piotr Mirowski, Matthew Koichi Grimes, Mateusz Malinowski, Karl Moritz Hermann, Keith Anderson, Denis Teplyashin, Karen Simonyan, Koray Kavukcuoglu, Andrew Zisserman, and Raia Hadsell. 2018 · 2018
Earlier work this paper cites.
Mapping instructions to actions in 3d environments with visual goal prediction
Dipendra Misra, Andrew Bennett, Valts Blukis, Eyvind Niklasson, Max Shatkhin, and Yoav Artzi. 2018 · 2018
Earlier work this paper cites.
Look before you leap: Bridging model-free and model-based reinforcement learning for planned-ahead vision-and-language navigation
Xin Wang, Wenhan Xiong, Hongmin Wang, and William Yang Wang. 2018 · 2018
Earlier work this paper cites.
Building generalizable agents with a realistic and rich 3d environment
Yi Wu, Yuxin Wu, Georgia Gkioxari, and Yuandong Tian. 2018 · 2018
Earlier work this paper cites.
Gibson env: Real-world perception for embodied agents
Fei Xia, Amir R. Zamir, Zhiyang He, Alexander Sax, Jitendra Malik, and Silvio Savarese. 2018 · 2018
Earlier work this paper cites.
Learning to map natural language instructions to physical quadcopter control using simulated flight
Valts Blukis, Yannick Terme, Eyvind Niklasson, Ross A. Knepper, and Yoav Artzi. 2019 · 2019
Earlier work this paper cites.
Touchdown: Natural language navigation and spatial reasoning in visual street environments
Howard Chen, Alane Suhr, Dipendra Misra, Noah Snavely, and Yoav Artzi. 2019 · 2019
Earlier work this paper cites.
Bert: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Earlier work this paper cites.
Are you looking? grounding to multiple modalities in vision-and-language navigation
Ronghang Hu, Daniel Fried, Anna Rohrbach, Dan Klein, Trevor Darrell, and Kate Saenko. 2019 · 2019
Earlier work this paper cites.
Stay on the path: Instruction fidelity in vision-and-language navigation
Vihan Jain, Gabriel Magalhaes, Alexander Ku, Ashish Vaswani, Eugene Ie, and Jason Baldridge. 2019 · 2019
Cited alongside, same era.
Tactical rewind: Self-correction via backtracking in vision-and-language navigation
Liyiming Ke, Xiujun Li, Yonatan Bisk, Ari Holtzman, Zhe Gan, Jingjing Liu, Jianfeng Gao, Yejin Choi, and Siddhartha Srinivasa. 2019 · 2019
Cited alongside, same era.
Embodied vision-and-language navigation with dynamic convolutional filters
Federico Landi, Lorenzo Baraldi, Massimiliano Corsini, and Rita Cucchiara. 2019 · 2019
Cited alongside, same era.
Robust navigation with language pretraining and stochastic sampling
Xiujun Li, Chunyuan Li, Qiaolin Xia, Yonatan Bisk, Asli Celikyilmaz, Jianfeng Gao, Noah Smith, and Yejin Choi. 2019 · 2019
Cited alongside, same era.
Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks
Jiasen Lu, Dhruv Batra, Devi Parikh, and Stefan Lee. 2019 · 2019
Cited alongside, same era.
RMM: A recursive mental model for dialog navigation
Homero Roman Roman, Yonatan Bisk, Jesse Thomason, Asli Celikyilmaz, and Jianfeng Gao. 2020 · 2020
Later among the works it cites.
ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Tasks
Mohit Shridhar, Jesse Thomason, Daniel Gordon, Yonatan Bisk, Winson Han, Roozbeh Mottaghi, Luke Zettlemoyer, and Dieter Fox. 2020 · 2020
Later among the works it cites.
Multi-view learning for vision-and-language navigation
Qiaolin Xia, Xiujun Li, Chunyuan Li, Yonatan Bisk, Zhifang Sui, Jianfeng Gao, Yejin Choi, and Noah A. Smith. 2020 · 2020
Later among the works it cites.
Learning to stop: A simple yet effective approach to urban vision-language navigation
Jiannan Xiang, Xin Wang, and William Yang Wang. 2020 · 2020
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Habitat: A Platform for Embodied AI Research
Manolis Savva*, Abhishek Kadian*, Oleksandr Maksymets*, Yili Zhao, Erik Wijmans, Bhavana Jain, Julian Straub, Jia Liu, Vladlen Koltun, Jitendra Malik, Devi Parikh, and Dhruv Batra. 2019 · 2019
Cited alongside, same era.
Learning to navigate
Piotr Mirowski. 2019 · 2019
Cited alongside, same era.
Collaborative dialogue in Minecraft
Anjali Narayan-Chen, Prashant Jayannavar, and Julia Hockenmaier. 2019 · 2019
Cited alongside, same era.
Help, anna! visual navigation with natural multimodal assistance via retrospective curiosity-encouraging imitation learning
Khanh Nguyen and Hal Daumé III. 2019 · 2019
Cited alongside, same era.
Vision-based navigation with language-based assistance via imitation learning with indirect intervention
Khanh Nguyen, Debadeepta Dey, Chris Brockett, and Bill Dolan. 2019 · 2019
Cited alongside, same era.
Language models are unsupervised multitask learners
Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019
Cited alongside, same era.
Executing instructions in situated collaborative interactions
Alane Suhr, Claudia Yan, Jack Schluger, Stanley Yu, Hadi Khader, Marwa Mouallem, Iris Zhang, and Yoav Artzi. 2019 · 2019
Cited alongside, same era.
An Yan, Xin Eric Wang, Jiangtao Feng, Lei Li, and William Yang Wang. 2020 · 2020
Later among the works it cites.
Neighbor-view enhanced model for vision and language navigation
Dong An, Yuankai Qi, Yan Huang, Qi Wu, Liang Wang, and Tieniu Tan. 2021 · 2021
Later among the works it cites.
Room-and-object aware knowledge reasoning for remote embodied referring expression
Chen Gao, Jinyu Chen, Si Liu, Luting Wang, Qiong Zhang, and Qi Wu. 2021 · 2021
Later among the works it cites.
Airbert: In-domain pretraining for vision-and-language navigation
Pierre-Louis Guhur, Makarand Tapaswi, Shizhe Chen, Ivan Laptev, and Cordelia Schmid. 2021 · 2021
Later among the works it cites.
Landmark-rxr: Solving vision-and-language navigation with fine-grained alignment supervision
Keji He, Yan Huang, Qi Wu, Jianhua Yang, Dong An, Shuanglin Sima, and Liang Wang. 2021 · 2021
Later among the works it cites.
Vln bert: A recurrent vision-and-language bert for navigation
Yicong Hong, Qi Wu, Yuankai Qi, Cristian Rodriguez-Opazo, and Stephen Gould. 2021 · 2021
Later among the works it cites.
Hierarchical cross-modal agent for robotics vision-and-language navigation
Muhammad Zubair Irshad, Chih-Yao Ma, and Zsolt Kira. 2021 · 2021
Later among the works it cites.
Ndh-full: Learning and evaluating navigational agents on full-length dialogue
Hyounghun Kim, Jialu Li, and Mohit Bansal. 2021 · 2021
Later among the works it cites.
Pathdreamer: A world model for indoor navigation
Jing Yu Koh, Honglak Lee, Yinfei Yang, Jason Baldridge, and Peter Anderson. 2021 · 2021
Later among the works it cites.
Waypoint models for instruction-guided navigation in continuous environments
Jacob Krantz, Aaron Gokaslan, Dhruv Batra, Stefan Lee, and Oleksandr Maksymets. 2021 · 2021
Later among the works it cites.
Scene-intuitive agent for remote embodied visual grounding
Xiangru Lin, Guanbin Li, and Yizhou Yu. 2021 · 2021
Later among the works it cites.
Vision-language navigation with random environmental mixup
Chong Liu, Fengda Zhu, Xiaojun Chang, Xiaodan Liang, Zongyuan Ge, and Yi-Dong Shen. 2021 · 2021
Later among the works it cites.
Soat: A scene- and object-aware transformer for vision-and-language navigation
Abhinav Moudgil, Arjun Majumdar, Harsh Agrawal, Stefan Lee, and Dhruv Batra. 2021 · 2021
Later among the works it cites.
Teach: Task-driven embodied agents that chat
Aishwarya Padmakumar, Jesse Thomason, Ayush Shrivastava, Patrick Lange, Anjali Narayan-Chen, Spandana Gella, Robinson Piramithu, Gokhan Tur, and Dilek Hakkani-Tur. 2021 · 2021
Later among the works it cites.
Episodic transformer for vision-and-language navigation
Alexander Pashevich, Cordelia Schmid, and Chen Sun. 2021 · 2021
Later among the works it cites.
The road to know-where: An object-and-room informed sequential bert for indoor vision-language navigation
Yuankai Qi, Zizheng Pan, Yicong Hong, Ming-Hsuan Yang, Anton van den Hengel, and Qi Wu. 2021 · 2021
Later among the works it cites.
Language-aligned waypoint (law) supervision for vision-and-language navigation in continuous environments
Sonia Raychaudhuri, Saim Wani, Shivansh Patel, Unnat Jain, and Angel Chang. 2021 · 2021
Later among the works it cites.
Depth-guided adain and shift attention network for vision-and-language navigation
Q. Sun, Y. Zhuang, Z. Chen, Y. Fu, and X. Xue. 2021 · 2021
Later among the works it cites.
Habitat 2.0: Training home assistants to rearrange their habitat
Andrew Szot, Alex Clegg, Eric Undersander, Erik Wijmans, Yili Zhao, John Turner, Noah Maestre, Mustafa Mukadam, Devendra Chaplot, Oleksandr Maksymets, Aaron Gokaslan, Vladimir Vondrus, Sameer Dharur, Franziska Meier, Wojciech Galuba, Angel Chang, Zsolt Kira, Vladlen Koltun, Jitendra Malik, Manolis Savva, and Dhruv Batra. 2021 · 2021
Later among the works it cites.
Talk2nav: Long-range vision-and-language navigation with dual attention and spatial memory
Arun Balajee Vasudevan, Dengxin Dai, and Luc Van Gool. 2021 · 2021
Later among the works it cites.
Structured scene memory for vision-language navigation
Hanqing Wang, Wenguan Wang, Wei Liang, Caiming Xiong, and Jianbing Shen. 2021 · 2021
Later among the works it cites.
Curriculum learning for vision-and-language navigation
Jiwen Zhang, Zhongyu Wei, Jianqing Fan, and Jiajie Peng. 2021 · 2021
Later among the works it cites.
On the evaluation of vision-and-language navigation instructions
Ming Zhao, Peter Anderson, Vihan Jain, Su Wang, Alexander Ku, Jason Baldridge, and Eugene Ie. 2021 · 2021
Later among the works it cites.
Rethinking the spatial route prior in vision-and-language navigation
Xinzhe Zhou, Wei Liu, and Yadong Mu. 2021 · 2021
Later among the works it cites.
Dialfred: Dialogue-enabled agents for embodied instruction following
Xiaofeng Gao, Qiaozi Gao, Ran Gong, Kaixiang Lin, Govind Thattai, and Gaurav S Sukhatme. 2022 · 2022
Closest in time.
Envedit: Environment editing for vision-and-language navigation
Jialu Li, Hao Tan, and Mohit Bansal. 2022 · 2022
Closest in time.
Analyzing generalization of vision and language navigation to unseen outdoor areas
Raphael Schumann and Stefan Riezler. 2022 · 2022
Closest in time.
One step at a time: Long-horizon vision-and-language navigation with milestones
Chan Hee Song, Jihyung Kil, Tai-Yu Pan, Brian M Sadler, Wei-Lun Chao, and Yu Su. 2022 · 2022
Closest in time.
Self-supervised 3d semantic representation learning for vision-and-language navigation
Sinan Tan, Mengmeng Ge, Di Guo, Huaping Liu, and Fuchun Sun. 2022 · 2022
Closest in time.