On Evaluation of Embodied Navigation Agents

Understand

Skillful mobile operation in three-dimensional environments is a primary topic of study in Artificial Intelligence.

• The past two years have seen a surge of creative work on navigation.
• This creative output has produced a plethora of sometimes incompatible task definitions and evaluation protocols.
• To coordinate ongoing and future research in this area, we have convened a working group to study empirical methodology in navigation research.