Video Generation From Text

Understand

Generating videos from text has proven to be a significant challenge for existing generative models.

• We tackle this problem by training a conditional generative model to extract both static and dynamic information from text.
• This is manifested in a hybrid framework, employing a Variational Autoencoder (VAE) and a Generative Adversarial Network (GAN).
• The static features, called "gist," are used to sketch text-conditioned background color and object layout structure.