Creative Agents: Empowering Agents with Imagination for Creative Tasks

Understand

We study building embodied agents for open-ended creative tasks.

• While existing methods build instruction-following agents that can perform diverse open-ended tasks, none of them demonstrates creativity -- the ability to give novel and diverse solutions implicit in the language instructions.
• This limitation comes from their inability to convert abstract language instructions into concrete goals and perform long-horizon planning for such complicated goals.
• Given the observation that humans perform creative tasks with imagination, we propose a class of solutions, where the controller is enhanced with an imaginator generating detailed imaginations of task outcomes conditioned on language instructions.