BeyondScene: Higher-Resolution Human-Centric Scene Generation With Pretrained Diffusion

Understand

Generating higher-resolution human-centric scenes with details and controls remains a challenge for existing text-to-image diffusion models.

• This challenge stems from limited training image size, text encoder capacity (limited tokens), and the inherent difficulty of generating complex scenes involving multiple humans.
• While current methods attempted to address training size limit only, they often yielded human-centric scenes with severe artifacts.
• We propose BeyondScene, a novel framework that overcomes prior limitations, generating exquisite higher-resolution (over 8K) human-centric scenes with exceptional text-image correspondence and naturalness using existing pretrained diffusion models.