GOMAA-Geo: GOal Modality Agnostic Active Geo-localization

Understand

We consider the task of active geo-localization (AGL) in which an agent uses a sequence of visual cues observed during aerial navigation to find a target specified through multiple possible modalities.

• This could emulate a UAV involved in a search-and-rescue operation navigating through an area, observing a stream of aerial images as it goes.
• The AGL task is associated with two important challenges.
• Firstly, an agent must deal with a goal specification in one of multiple modalities (e.g., through a natural language description) while the search cues are provided in other modalities (aerial imagery).