Neural World Models for Computer Vision

Understand

Humans navigate in their environment by learning a mental model of the world through passive observation and active interaction.

• Their world model allows them to anticipate what might happen next and act accordingly with respect to an underlying objective.
• Such world models hold strong promises for planning in complex environments like in autonomous driving.
• A human driver, or a self-driving system, perceives their surroundings with their eyes or their cameras.