Visually-Grounded Planning without Vision: Language Models Infer Detailed Plans from High-level Instructions

Shifting the baseline: Single modality performance on visual navigation & QA

Jesse Thomason, Daniel Gordon, and Yonatan Bisk. 2019 · 1983

Earlier work this paper cites.

Glove: Global vectors for word representation

Jeffrey Pennington, Richard Socher, and Christopher D. Manning. 2014 · 2014

Earlier work this paper cites.

Neural machine translation by jointly learning to align and translate

Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015 · 2015

Earlier work this paper cites.

Ai2-thor: An interactive 3d environment for visual ai

Original

Eric Kolve, Roozbeh Mottaghi, Winson Han, Eli VanderBilt, Luca Weihs, Alvaro Herrasti, Daniel Gordon, Yuke Zhu, Abhinav Gupta, and Ali Farhadi. 2017 · 2017

Earlier work this paper cites.

Visual semantic planning using deep successor representations

Original

Yuke Zhu, Daniel Gordon, Eric Kolve, Dieter Fox, Li Fei-Fei, Abhinav Gupta, Roozbeh Mottaghi, and Ali Farhadi. 2017 · 2017

Earlier work this paper cites.

Vision-and-language navigation: Interpreting visually-grounded navigation instructions in real environments

Peter Anderson, Qi Wu, Damien Teney, Jake Bruce, Mark Johnson, Niko Sünderhauf, Ian Reid, Stephen Gould, and Anton van den Hengel. 2018 · 2018

Earlier work this paper cites.

Hierarchical neural story generation

Angela Fan, Mike Lewis, and Yann Dauphin. 2018 · 2018

Earlier work this paper cites.

Speaker-follower models for vision-and-language navigation

Daniel Fried, Ronghang Hu, Volkan Cirik, Anna Rohrbach, Jacob Andreas, Louis-Philippe Morency, Taylor Berg-Kirkpatrick, Kate Saenko, Dan Klein, and Trevor Darrell. 2018 · 2018

Cited alongside, same era.

Iqa: Visual question answering in interactive environments

Daniel Gordon, Aniruddha Kembhavi, Mohammad Rastegari, Joseph Redmon, Dieter Fox, and Ali Farhadi. 2018 · 2018

Cited alongside, same era.

Virtualhome: Simulating household activities via programs

Xavier Puig, Kevin Ra, Marko Boben, Jiaman Li, Tingwu Wang, Sanja Fidler, and Antonio Torralba. 2018 · 2018

Cited alongside, same era.

Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task

Tao Yu, Rui Zhang, Kai Yang, Michihiro Yasunaga, Dongxu Wang, Zifan Li, James Ma, Irene Li, Qingning Yao, Shanelle Roman, et al. 2018 · 2018

Cited alongside, same era.

Scene memory transformer for embodied agents in long-horizon tasks

Kuan Fang, Alexander Toshev, Li Fei-Fei, and Silvio Savarese. 2019 · 2019

Cited alongside, same era.

Are you looking? grounding to multiple modalities in vision-and-language navigation

Ronghang Hu, Daniel Fried, Anna Rohrbach, Dan Klein, Trevor Darrell, and Kate Saenko. 2019 · 2019

Later among the works it cites.

Language models as knowledge bases?

Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, and Alexander Miller. 2019 · 2019

Later among the works it cites.

Language models are unsupervised multitask learners

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019

Later among the works it cites.

Embodied question answering in photorealistic environments with point cloud perception

Erik Wijmans, Samyak Datta, Oleksandr Maksymets, Abhishek Das, Georgia Gkioxari, Stefan Lee, Irfan Essa, Devi Parikh, and Dhruv Batra. 2019 · 2019

Later among the works it cites.

The curious case of neural text degeneration

Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi. 2020 · 2020

Closest in time.