World Knowledge from AI Image Generation for Robot Control

Understand

When interacting with the world robots face a number of difficult questions, having to make decisions when given under-specified tasks where they need to make choices, often without clearly defined right and wrong answers.

• Humans, on the other hand, can often rely on their knowledge and experience to fill in the gaps.
• For example, the simple task of organizing newly bought produce into the fridge involves deciding where to put each thing individually, how to arrange them together meaningfully, e.g.
• putting related things together, all while there is no clear right and wrong way to accomplish this task.