EasyAnimate: High-Performance Video Generation Framework with Hybrid Windows Attention and Reward Backpropagation

Exploring the limits of transfer learning with a unified text-to-text transformer

Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020 · 2020

Earlier work this paper cites.

Raft: Recurrent all-pairs field transforms for optical flow

Zachary Teed and Jia Deng. 2020 · 2020

Earlier work this paper cites.

High-resolution image synthesis with latent diffusion models

Original

Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. 2021 · 2021

Earlier work this paper cites.

All are worth words: A vit backbone for diffusion models

Fan Bao, Shen Nie, Kaiwen Xue, Yue Cao, Chongxuan Li, Hang Su, and Jun Zhu. 2023 · 2023

Earlier work this paper cites.

Stable video diffusion: Scaling latent video diffusion models to large datasets

Original

Andreas Blattmann, Tim Dockhorn, Sumith Kulal, Daniel Mendelevitch, Maciej Kilian, Dominik Lorenz, Yam Levi, Zion English, Vikram Voleti, Adam Letts, et al. 2023 · 2023

Earlier work this paper cites.

Animatediff: Animate your personalized text-to-image diffusion models without specific tuning

Original

Yuwei Guo, Ceyuan Yang, Anyi Rao, Yaohui Wang, Yu Qiao, Dahua Lin, and Bo Dai. 2023 · 2023

Earlier work this paper cites.

Segment anything

Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C. Berg, Wan-Yen Lo, Piotr Dollár, and Ross B. Girshick. 2023 · 2023

Cited alongside, same era.

Videochat: Chat-centric video understanding

Original

Kunchang Li, Yinan He, Yi Wang, Yizhuo Li, Wenhai Wang, Ping Luo, Yali Wang, Limin Wang, and Yu Qiao. 2023 · 2023

Cited alongside, same era.

Vila: On pre-training for visual language models

Original

Ji Lin, Hongxu Yin, Wei Ping, Yao Lu, Pavlo Molchanov, Andrew Tao, Huizi Mao, Jan Kautz, Mohammad Shoeybi, and Song Han. 2023 · 2023

Cited alongside, same era.

Videofusion: Decomposed diffusion models for high-quality video generation

Zhengxiong Luo, Dayou Chen, Yingya Zhang, Yan Huang, Liang Wang, Yujun Shen, Deli Zhao, Jingren Zhou, and Tieniu Tan. 2023 · 2023

Cited alongside, same era.

Journeydb: A benchmark for generative image understanding

Original

Modelscope text-to-video technical report

Original

Jiuniu Wang, Hangjie Yuan, Dayou Chen, Yingya Zhang, Xiang Wang, and Shiwei Zhang. 2023 · 2023

Later among the works it cites.

Language model beats diffusion–tokenizer is key to visual generation

Original

Lijun Yu, José Lezama, Nitesh B Gundavarapu, Luca Versari, Kihyuk Sohn, David Minnen, Yong Cheng, Agrim Gupta, Xiuye Gu, Alexander G Hauptmann, et al. 2023 · 2023

Later among the works it cites.

Videocrafter2: Overcoming data limitations for high-quality video diffusion models

Original

Haoxin Chen, Yong Zhang, Xiaodong Cun, Menghan Xia, Xintao Wang, Chao Weng, and Ying Shan. 2024 · 2024

Closest in time.

Open-sora: Democratizing efficient video production for all

hpcaitech. 2024 · 2024

Closest in time.

Open-sora-plan

PKU-Yuan Lab and Tuzhan AI etc. 2024 · 2024

Closest in time.