RELATE: Physically Plausible Multi-Object Scene Synthesis Using Structured Latent Spaces

Understand

We present RELATE, a model that learns to generate physically plausible scenes and videos of multiple interacting objects.

• Similar to other generative approaches, RELATE is trained end-to-end on raw, unlabeled data.
• RELATE combines an object-centric GAN formulation with a model that explicitly accounts for correlations between individual objects.
• This allows the model to generate realistic scenes and videos from a physically-interpretable parameterization.