AVID: Adapting Video Diffusion Models to World Models

Planning and acting in partially observable stochastic domains

Leslie Pack Kaelbling, Michael L Littman, and Anthony R Cassandra · 1998

Earlier work this paper cites.

Image quality assessment: from error visibility to structural similarity

Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli · 2004

Earlier work this paper cites.

Image quality metrics: PSNR vs. SSIM

Alain Hore and Djemel Ziou · 2010

Earlier work this paper cites.

U-net: Convolutional networks for biomedical image segmentation

Olaf Ronneberger, Philipp Fischer, and Thomas Brox · 2015

Earlier work this paper cites.

Very deep convolutional networks for large-scale image recognition

Karen Simonyan and Andrew Zisserman · 2015

Earlier work this paper cites.

Deep unsupervised learning using nonequilibrium thermodynamics

Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli · 2015

Earlier work this paper cites.

Going deeper with convolutions

Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich · 2015

Earlier work this paper cites.

Quo vadis, action recognition? a new model and the kinetics dataset

Joao Carreira and Andrew Zisserman · 2017

Earlier work this paper cites.

GANs trained by a two time-scale update rule converge to a local nash equilibrium

Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter · 2017

Earlier work this paper cites.

World models

David Ha and Jürgen Schmidhuber · 2018

Earlier work this paper cites.

FiLM: Visual reasoning with a general conditioning layer

Ethan Perez, Florian Strub, Harm De Vries, Vincent Dumoulin, and Aaron Courville · 2018

Earlier work this paper cites.

The unreasonable effectiveness of deep features as a perceptual metric

Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang · 2018

Earlier work this paper cites.

Fvd: A new metric for video generation

Karl Cobbe, Chris Hesse, Jacob Hilton, and John Schulman · 2019

Earlier work this paper cites.

Applied stochastic differential equations , volume 10

Simo Särkkä and Arno Solin · 2019

Earlier work this paper cites.

Language models are few-shot learners

Tom B Brown · 2020

Earlier work this paper cites.

Leveraging procedural generation to benchmark reinforcement learning

Karl Cobbe, Chris Hesse, Jacob Hilton, and John Schulman · 2020

Earlier work this paper cites.

Compositional visual generation with energy based models

Yilun Du, Shuang Li, and Igor Mordatch · 2020

Earlier work this paper cites.

Denoising diffusion probabilistic models

Jonathan Ho, Ajay Jain, and Pieter Abbeel · 2020

Earlier work this paper cites.

Diffusion models beat gans on image synthesis

Prafulla Dhariwal and Alexander Nichol · 2021

Earlier work this paper cites.

Mastering atari with discrete world models

Danijar Hafner, Timothy Lillicrap, Mohammad Norouzi, and Jimmy Ba · 2021

Earlier work this paper cites.

Classifier-free diffusion guidance

Jonathan Ho and Tim Salimans · 2021

Earlier work this paper cites.

Controllable and compositional generation with latent-space energy-based models

Weili Nie, Arash Vahdat, and Anima Anandkumar · 2021

Cited alongside, same era.

Learning transferable visual models from natural language supervision

Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al · 2021

Cited alongside, same era.

Video pretraining (VPT): Learning to act by watching unlabeled online videos

Bowen Baker, Ilge Akkaya, Peter Zhokov, Joost Huizinga, Jie Tang, Adrien Ecoffet, Brandon Houghton, Raul Sampedro, and Jeff Clune · 2022

Cited alongside, same era.

RT-1: Robotics transformer for real-world control at scale

Original

Anthony Brohan, Noah Brown, Justice Carbajal, Yevgen Chebotar, Joseph Dabis, Chelsea Finn, Keerthana Gopalakrishnan, Karol Hausman, Alex Herzog, Jasmine Hsu, et al · 2022

Cited alongside, same era.

Planning with diffusion for flexible behavior synthesis

Michael Janner, Yilun Du, Joshua B Tenenbaum, and Sergey Levine · 2022

Imitating human behaviour with diffusion models

Tim Pearce, Tabish Rashid, Anssi Kanervisto, Dave Bignell, Mingfei Sun, Raluca Georgescu, Sergio Valcarcel Macua, Shan Zheng Tan, Ida Momennejad, Katja Hofmann, et al · 2023

Later among the works it cites.

SDXL: Improving latent diffusion models for high-resolution image synthesis

Original

Dustin Podell, Zion English, Kyle Lacey, Andreas Blattmann, Tim Dockhorn, Jonas Müller, Joe Penna, and Robin Rombach · 2023

Later among the works it cites.

Llama 2: Open foundation and fine-tuned chat models

Original

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al · 2023

Later among the works it cites.

Dynamicrafter: Animating open-domain images with video diffusion priors

Original

Jinbo Xing, Menghan Xia, Yong Zhang, Haoxin Chen, Xintao Wang, Tien-Tsin Wong, and Ying Shan · 2023

Later among the works it cites.