MarDini: Masked Autoregressive Diffusion for Video Generation at Scale

Long short-term memory

Sepp Hochreiter and Jürgen Schmidhuber · 1997

Earlier work this paper cites.

Equilibrium free-energy differences from nonequilibrium measurements: A master-equation approach

Christopher Jarzynski · 1997

Earlier work this paper cites.

Learning to forget: Continual prediction with LSTM

Felix A Gers, Jürgen Schmidhuber, and Fred Cummins · 2000

Earlier work this paper cites.

Annealed importance sampling

Radford M Neal · 2001

Earlier work this paper cites.

Image quality assessment: from error visibility to structural similarity

Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli · 2004

Earlier work this paper cites.

UCF101: A dataset of 101 human actions classes from videos in the wild

Original

Khurram Soomro, Amir Zamir, and Mubarak Shah · 2012

Earlier work this paper cites.

Auto-encoding variational Bayes

Diederik P. Kingma and Max Welling · 2014

Earlier work this paper cites.

Deep learning in neural networks: An overview

Jürgen Schmidhuber · 2015

Earlier work this paper cites.

Layer normalization

Original

Jimmy Ba, Jamie Ryan Kiros, and Geoffrey E. Hinton · 2016

Earlier work this paper cites.

GANs trained by a two time-scale update rule converge to a local nash equilibrium

Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter · 2017

Earlier work this paper cites.

Arbitrary style transfer in real-time with adaptive instance normalization

Xun Huang and Serge Belongie · 2017

Earlier work this paper cites.

The 2017 davis challenge on video object segmentation

Original

Jordi Pont-Tuset, Federico Perazzi, Sergi Caelles, Pablo Arbeláez, Alex Sorkine-Hornung, and Luc Van Gool · 2017

Earlier work this paper cites.

Neural discrete representation learning

Aaron Van Den Oord, Oriol Vinyals, et al · 2017

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017

Earlier work this paper cites.

Progressive growing of GANs for improved quality, stability, and variation

Tero Karras · 2018

Earlier work this paper cites.

Towards accurate generative models of video: A new metric & challenges

Original

Thomas Unterthiner, Sjoerd Van Steenkiste, Karol Kurach, Raphael Marinier, Marcin Michalski, and Sylvain Gelly · 2018

Earlier work this paper cites.

The unreasonable effectiveness of deep features as a perceptual metric

Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang · 2018

Earlier work this paper cites.

Bert: Pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2019

Earlier work this paper cites.

Generating diverse high-fidelity images with VQ-VAE-2

Ali Razavi, Aaron Van den Oord, and Oriol Vinyals · 2019

Earlier work this paper cites.

Root mean square layer normalization

Biao Zhang and Rico Sennrich · 2019

Earlier work this paper cites.

Language models are few-shot learners

Original

Tom B Brown · 2020

Earlier work this paper cites.

Denoising diffusion probabilistic models

Jonathan Ho, Ajay Jain, and Pieter Abbeel · 2020

Earlier work this paper cites.

Diffusion models beat GANs on image synthesis

Prafulla Dhariwal and Alexander Nichol · 2021

Earlier work this paper cites.

Taming transformers for high-resolution image synthesis

Patrick Esser, Robin Rombach, and Bjorn Ommer · 2021

Earlier work this paper cites.

Masked autoencoders are scalable vision learners

Original

Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, and Ross Girshick · 2021

Earlier work this paper cites.

Zero-shot text-to-image generation

Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever · 2021

Earlier work this paper cites.

Linear transformers are secretly fast weight programmers

Imanol Schlag, Kazuki Irie, and Jürgen Schmidhuber · 2021

Earlier work this paper cites.

Denoising diffusion implicit models

Jiaming Song, Chenlin Meng, and Stefano Ermon · 2021

Cited alongside, same era.

Low-fidelity video encoder optimization for temporal action localization

Mengmeng Xu, Juan Manuel Perez Rua, Xiatian Zhu, Bernard Ghanem, and Brais Martinez · 2021

Cited alongside, same era.

Vector-quantized image modeling with improved vqgan

Jiahui Yu, Xin Li, Jing Yu Koh, Han Zhang, Ruoming Pang, James Qin, Alexander Ku, Yuanzhong Xu, Jason Baldridge, and Yonghui Wu · 2021

Cited alongside, same era.

MaskGiT: Masked generative image transformer

Huiwen Chang, Han Zhang, Lu Jiang, Ce Liu, and William T Freeman · 2022

Cited alongside, same era.

Google scanned objects: A high-quality dataset of 3d scanned household items

Laura Downs, Anthony Francis, Nate Koenig, Brandon Kinman, Ryan Hickman, Krista Reymann, Thomas B McHugh, and Vincent Vanhoucke · 2022

Cited alongside, same era.

Classifier-free diffusion guidance

Jonathan Ho and Tim Salimans · 2022

LLAMA 2: Open foundation and fine-tuned chat models

Original

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al · 2023

Later among the works it cites.

Modelscope text-to-video technical report

Original

Jiuniu Wang, Hangjie Yuan, Dayou Chen, Yingya Zhang, Xiang Wang, and Shiwei Zhang · 2023

Later among the works it cites.

Novel view synthesis with diffusion models

Daniel Watson, William Chan, Ricardo Martin-Brualla, Jonathan Ho, Andrea Tagliasacchi, and Mohammad Norouzi · 2023

Later among the works it cites.

Tune-a-video: One-shot tuning of image diffusion models for text-to-video generation

Jay Zhangjie Wu, Yixiao Ge, Xintao Wang, Stan Weixian Lei, Yuchao Gu, Yufei Shi, Wynne Hsu, Ying Shan, Xiaohu Qie, and Mike Zheng Shou · 2023

Later among the works it cites.

Pytorch FSDP: experiences on scaling fully sharded data parallel