Emergence of Structured Behaviors from Curiosity-Based Intrinsic Motivation

Understand

Infants are experts at playing, with an amazing ability to generate novel structured behaviors in unstructured environments that lack clear extrinsic reward signals.

• We seek to replicate some of these abilities with a neural network that implements curiosity-driven intrinsic motivation.
• Using a simple but ecologically naturalistic simulated environment in which the agent can move and interact with objects it sees, the agent learns a world model predicting the dynamic consequences of its actions.
• Simultaneously, the agent learns to take actions that adversarially challenge the developing world model, pushing the agent to explore novel and informative interactions with its environment.