Fetching the paper…

Reading the bibliography…

2023

Reasoning about the Unseen for Efficient Outdoor Object Navigation

Xie, Quanting, Zhang, Tianyi, Xu, Kedi et al.

Original
PDF
Post on X

Understand

Robots should exist anywhere humans do: indoors, outdoors, and even unmapped environments.

In contrast, the focus of recent advancements in Object Goal Navigation(OGN) has targeted navigating in indoor environments by leveraging spatial and semantic cues that do not generalize outdoors.
While these contributions provide valuable insights into indoor scenarios, the broader spectrum of real-world robotic applications often extends to outdoor settings.
As we transition to the vast and complex terrains of outdoor environments, new challenges emerge.

Reasoning about the Unseen for Efficient Outdoor Object Navigation · Around

Built on

“A frontier-based approach for autonomous exploration”
B. Yamauchi · 1997
Earlier work this paper cites.
“Language Models are Few-Shot Learners”, 2020
Original
Tom. Brown et al · 2005
Earlier work this paper cites.
“AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehicles”, 2017
Original
Shital Shah, Debadeepta Dey, Chris Lovett and Ashish Kapoor · 2017
Earlier work this paper cites.
“On Evaluation of Embodied Navigation Agents”, 2018
Original
Peter Anderson et al · 2018
Earlier work this paper cites.
“Coupled Indoor Navigation for People Who Are Blind”
Amal Nanavati, Xiang Tan and Aaron Steinfeld · 2018
Earlier work this paper cites.
“Bert: Pre-training of deep bidirectional transformers for language understanding”
Original
Jacob Devlin, Ming-Wei Chang, Kenton Lee and Kristina Toutanova · 2018
Earlier work this paper cites.
“Object Goal Navigation using Goal-Oriented Semantic Exploration”
Devendra Chaplot, Dhiraj Gandhi, Abhinav Gupta and Ruslan Salakhutdinov · 2020
Earlier work this paper cites.
“Learning To Explore Using Active Neural SLAM”
Devendra Chaplot et al · 2020
Earlier work this paper cites.
“Improving vision-and-language navigation with image-text pairs from the web”
Arjun Majumdar et al · 2020
Earlier work this paper cites.
“Sim-to-Real Transfer for Vision-and-Language Navigation”
Peter Anderson et al · 2021
Earlier work this paper cites.
“On the Dangers of Stochastic Parrots: Can Language Models Be Too Big?”
Emily. Bender, Timnit Gebru, Angelina McMillan-Major and Shmargaret Shmitchell · 2021
Earlier work this paper cites.
“ZSON: Zero-Shot Object-Goal Navigation using Multimodal Goal Embeddings”, 2022
Original
Arjun Majumdar et al · 2022
Earlier work this paper cites.

Similar

“FILM: Following Instructions in Language with Modular Methods”
So Min et al · 2022
Cited alongside, same era.
“Do As I Can and Not As I Say: Grounding Language in Robotic Affordances”
Original
Michael Ahn et al · 2022
Cited alongside, same era.
“Rt-1: Robotics transformer for real-world control at scale”
Original
Anthony Brohan et al · 2022
Cited alongside, same era.
“Inner Monologue: Embodied Reasoning through Planning with Language Models”
Original
Wenlong Huang et al · 2022
Cited alongside, same era.
“React: Synergizing reasoning and acting in language models”
Original
Shunyu Yao et al · 2022
Cited alongside, same era.

Then

“Tree of Thoughts: Deliberate Problem Solving with Large Language Models”, 2023
Original
Shunyu Yao et al · 2023
Closest in time.
“Decomposition Enhances Reasoning via Self-Evaluation Guided Decoding”, 2023
Original
Yuxi Xie et al · 2023
Closest in time.
“Reasoning with language model is planning with world model”
Original
Shibo Hao et al · 2023
Closest in time.
“Large Language Models as Commonsense Knowledge for Large-Scale Task Planning”
Zirui Zhao, Wee Lee and David Hsu · 2023
Closest in time.
“Planning with Large Language Models for Code Generation”
Shun Zhang et al · 2023
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

“How Does It Feel? Self-Supervised Costmap Learning for Off-Road Vehicle Traversability”

Mateo Castro et al · 2023

Cited alongside, same era.

“GPT-4 Technical Report”, 2023

OpenAI · 2023

Cited alongside, same era.

“Lm-nav: Robotic navigation with large pre-trained models of language, vision, and action”

Dhruv Shah, Ba“.zej Osi“’nski and Sergey Levine · 2023

Cited alongside, same era.

“How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontiers”, 2023

Junting Chen et al · 2023

Cited alongside, same era.

“ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigation”, 2023

Kaiwen Zhou et al · 2023

Cited alongside, same era.

“NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models”, 2023

Gengze Zhou, Yicong Hong and Qi Wu · 2023

Cited alongside, same era.

“Chain-of-Thought Prompting Elicits Reasoning in Large Language Models”, 2023

Jason Wei et al · 2023

Cited alongside, same era.

“Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models”, 2023

Lei Wang et al · 2023

Closest in time.

“Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents”, 2023

Zihao Wang et al · 2023

Closest in time.

“ReAct: Synergizing Reasoning and Acting in Language Models”, 2023

Shunyu Yao et al · 2023

Closest in time.

“Can an embodied agent find your” cat-shaped mug”? llm-based zero-shot object navigation”

Vishnu Dorbala, James Mullen and Dinesh Manocha · 2023

Closest in time.

“VELMA: Verbalization Embodiment of LLM Agents for Vision and Language Navigation in Street View”, 2023

Raphael Schumann et al · 2023

Closest in time.

“Sources of Hallucination by Large Language Models on Inference Tasks”

Nick McKenna et al · 2023

Closest in time.

“Kosmos-2: Grounding Multimodal Large Language Models to the World”

Zhiliang Peng et al · 2023

Closest in time.