ULN: Towards Underspecified Vision-and-Language Navigation

Understand

Vision-and-Language Navigation (VLN) is a task to guide an embodied agent moving to a target position using language instructions.

• Despite the significant performance improvement, the wide use of fine-grained instructions fails to characterize more practical linguistic variations in reality.
• To fill in this gap, we introduce a new setting, namely Underspecified vision-and-Language Navigation (ULN), and associated evaluation datasets.
• ULN evaluates agents using multi-level underspecified instructions instead of purely fine-grained or coarse-grained, which is a more realistic and general setting.