Reenact Anything: Semantic Video Motion Transfer Using Motion-Textual Inversion

Plug-and-play diffusion features for text-driven image-to-image translation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 1921–1930

Narek Tumanyan, Michal Geyer, Shai Bagon, and Tali Dekel. 2023 · 1930

Earlier work this paper cites.

Adam: A Method for Stochastic Optimization. In 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings , Yoshua Bengio and Yann LeCun (Eds.)

Original

Diederik P. Kingma and Jimmy Ba. 2015 · 2015

Earlier work this paper cites.

The" something something" video database for learning and evaluating visual common sense. In Proceedings of the IEEE international conference on computer vision . 5842–5850

Raghav Goyal, Samira Ebrahimi Kahou, Vincent Michalski, Joanna Materzynska, Susanne Westphal, Heuna Kim, Valentin Haenel, Ingo Fruend, Peter Yianilos, Moritz Mueller-Freitag, et al · 2017

Earlier work this paper cites.

Everybody dance now. In Proceedings of the IEEE/CVF international conference on computer vision . 5933–5942

Caroline Chan, Shiry Ginosar, Tinghui Zhou, and Alexei A Efros. 2019 · 2019

Earlier work this paper cites.

Fsgan: Subject agnostic face swapping and reenactment. In Proceedings of the IEEE/CVF international conference on computer vision . 7184–7193

Yuval Nirkin, Yosi Keller, and Tal Hassner. 2019 · 2019

Earlier work this paper cites.

First order motion model for image animation

Aliaksandr Siarohin, Stéphane Lathuilière, Sergey Tulyakov, Elisa Ricci, and Nicu Sebe. 2019 · 2019

Earlier work this paper cites.

Denoising diffusion probabilistic models

Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020 · 2020

Earlier work this paper cites.

Denoising diffusion implicit models

Original

Jiaming Song, Chenlin Meng, and Stefano Ermon. 2020 · 2020

Earlier work this paper cites.

Transmomo: Invariance-driven unsupervised video motion retargeting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 5306–5315

Zhuoqian Yang, Wentao Zhu, Wayne Wu, Chen Qian, Qiang Zhou, Bolei Zhou, and Chen Change Loy. 2020 · 2020

Earlier work this paper cites.

Classifier-Free Diffusion Guidance. In NeurIPS 2021 Workshop on Deep Generative Models and Downstream Applications

Jonathan Ho and Tim Salimans. 2021 · 2021

Earlier work this paper cites.

Learning transferable visual models from natural language supervision. In International conference on machine learning . PMLR, 8748–8763

Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al · 2021

Earlier work this paper cites.

Motion representations for articulated animation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 13653–13662

Aliaksandr Siarohin, Oliver J Woodford, Jian Ren, Menglei Chai, and Sergey Tulyakov. 2021 · 2021

Earlier work this paper cites.

Score-Based Generative Modeling through Stochastic Differential Equations. In International Conference on Learning Representations

Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. 2021 · 2021

Earlier work this paper cites.

One-shot free-view neural talking-head synthesis for video conferencing. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition . 10039–10049

Ting-Chun Wang, Arun Mallya, and Ming-Yu Liu. 2021 · 2021

Earlier work this paper cites.

Megaportraits: One-shot megapixel neural head avatars. In Proceedings of the 30th ACM International Conference on Multimedia . 2663–2671

Nikita Drobyshev, Jenya Chelishev, Taras Khakhulin, Aleksei Ivakhnenko, Victor Lempitsky, and Egor Zakharov. 2022 · 2022

Earlier work this paper cites.

Dual-generator face reenactment. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 642–650

Gee-Sern Hsu, Chun-Hung Tsai, and Hung-Yi Wu. 2022 · 2022

Earlier work this paper cites.

Lora: Low-rank adaptation of large language models

Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, et al · 2022

Earlier work this paper cites.

Elucidating the design space of diffusion-based generative models

Tero Karras, Miika Aittala, Timo Aila, and Samuli Laine. 2022 · 2022

Earlier work this paper cites.

JOKR: Joint Keypoint Representation for Unsupervised Video Retargeting. In Computer Graphics Forum , Vol. 41. Wiley Online Library, 245–257

Ron Mokady, Rotem Tzaban, Sagie Benaim, Amit H Bermano, and Daniel Cohen-Or. 2022 · 2022

Earlier work this paper cites.

Hierarchical text-conditional image generation with clip latents

Original

Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. 2022 · 2022

Earlier work this paper cites.

High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition . 10684–10695

Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. 2022 · 2022

Earlier work this paper cites.

Photorealistic text-to-image diffusion models with deep language understanding

Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily L Denton, Kamyar Ghasemipour, Raphael Gontijo Lopes, Burcu Karagol Ayan, Tim Salimans, et al · 2022

Earlier work this paper cites.

Videomae: Masked autoencoders are data-efficient learners for self-supervised video pre-training

Zhan Tong, Yibing Song, Jue Wang, and Limin Wang. 2022 · 2022

Earlier work this paper cites.

Diffusers: State-of-the-art diffusion models

Patrick von Platen, Suraj Patil, Anton Lozhkov, Pedro Cuenca, Nathan Lambert, Kashif Rasul, Mishig Davaadorj, Dhruv Nair, Sayak Paul, William Berman, Yiyi Xu, Steven Liu, and Thomas Wolf. 2022 · 2022

Earlier work this paper cites.

Thin-plate spline motion model for image animation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 3657–3666

Jian Zhao and Hui Zhang. 2022 · 2022

Earlier work this paper cites.

Stable video diffusion: Scaling latent video diffusion models to large datasets

Original

Andreas Blattmann, Tim Dockhorn, Sumith Kulal, Daniel Mendelevitch, Maciej Kilian, Dominik Lorenz, Yam Levi, Zion English, Vikram Voleti, Adam Letts, et al · 2023

Earlier work this paper cites.

Pix2video: Video editing using image diffusion. In Proceedings of the IEEE/CVF International Conference on Computer Vision . 23206–23217

Duygu Ceylan, Chun-Hao P Huang, and Niloy J Mitra. 2023 · 2023

Earlier work this paper cites.

Motion-conditioned diffusion model for controllable video synthesis

Original

Tsai-Shien Chen, Chieh Hubert Lin, Hung-Yu Tseng, Tsung-Yi Lin, and Ming-Hsuan Yang. 2023a · 2023

Earlier work this paper cites.

Control-a-video: Controllable text-to-video generation with diffusion models

Original

Weifeng Chen, Jie Wu, Pan Xie, Hefeng Wu, Jiashi Li, Xin Xia, Xuefeng Xiao, and Liang Lin. 2023b · 2023

Earlier work this paper cites.

AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidance

Zuozhuo Dai, Zhenghao Zhang, Yao Yao, Bingxue Qiu, Siyu Zhu, Long Qin, and Weizhi Wang. 2023 · 2023

Earlier work this paper cites.

An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversion. In The Eleventh International Conference on Learning Representations

Rinon Gal, Yuval Alaluf, Yuval Atzmon, Or Patashnik, Amit Haim Bermano, Gal Chechik, and Daniel Cohen-or. 2023 · 2023

Earlier work this paper cites.

Unsupervised semantic correspondence using stable diffusion

Eric Hedlin, Gopal Sharma, Shweta Mahajan, Hossam Isack, Abhishek Kar, Andrea Tagliasacchi, and Kwang Moo Yi. 2023 · 2023

Earlier work this paper cites.

Prompt-to-Prompt Image Editing with Cross-Attention Control. In The Eleventh International Conference on Learning Representations

Amir Hertz, Ron Mokady, Jay Tenenbaum, Kfir Aberman, Yael Pritch, and Daniel Cohen-or. 2023 · 2023

Earlier work this paper cites.

Dreampose: Fashion image-to-video synthesis via stable diffusion. In 2023 IEEE/CVF International Conference on Computer Vision (ICCV) . IEEE, 22623–22633

Johanna Karras, Aleksander Holynski, Ting-Chun Wang, and Ira Kemelmacher-Shlizerman. 2023 · 2023

Earlier work this paper cites.

One-shot high-fidelity talking-head synthesis with deformable neural radiance field. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 17969–17978

Weichuang Li, Longhao Zhang, Dong Wang, Bin Zhao, Zhigang Wang, Mulin Chen, Bang Zhang, Zhongjian Wang, Liefeng Bo, and Xuelong Li. 2023 · 2023

Earlier work this paper cites.

Diffusion hyperfeatures: Searching through time and space for semantic correspondence

Grace Luo, Lisa Dunlap, Dong Huk Park, Aleksander Holynski, and Trevor Darrell. 2023 · 2023

Earlier work this paper cites.

Null-text inversion for editing real images using guided diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 6038–6047

Ron Mokady, Amir Hertz, Kfir Aberman, Yael Pritch, and Daniel Cohen-Or. 2023 · 2023

Cited alongside, same era.

Dreamix: Video diffusion models are general video editors

Original

Eyal Molad, Eliahu Horwitz, Dani Valevski, Alex Rav Acha, Yossi Matias, Yael Pritch, Yaniv Leviathan, and Yedid Hoshen. 2023 · 2023

Cited alongside, same era.

Cross-identity video motion retargeting with joint transformation and synthesis. In Proceedings of the IEEE/CVF winter conference on applications of computer vision . 412–422

Haomiao Ni, Yihao Liu, Sharon X Huang, and Yuan Xue. 2023 · 2023

Cited alongside, same era.

Zero-shot image-to-image translation. In ACM SIGGRAPH 2023 Conference Proceedings . 1–11

Gaurav Parmar, Krishna Kumar Singh, Richard Zhang, Yijun Li, Jingwan Lu, and Jun-Yan Zhu. 2023 · 2023

Cited alongside, same era.

Vmc: Video motion customization using temporal attention adaption for text-to-video diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 9212–9221

Hyeonho Jeong, Geon Yeong Park, and Jong Chul Ye. 2024 · 2024

Closest in time.

Hunyuanvideo: A systematic framework for large video generative models

Original

Weijie Kong, Qi Tian, Zijian Zhang, Rox Min, Zuozhuo Dai, Jin Zhou, Jiangfeng Xiong, Xin Li, Bo Wu, Jianwei Zhang, et al · 2024

Closest in time.

Puppet-Master: Scaling Interactive Video Generation as a Motion Prior for Part-Level Dynamics

Original

Ruining Li, Chuanxia Zheng, Christian Rupprecht, and Andrea Vedaldi. 2024c · 2024

Closest in time.

MotionClone: Training-Free Motion Cloning for Controllable Video Generation

Original

Pengyang Ling, Jiazi Bu, Pan Zhang, Xiaoyi Dong, Yuhang Zang, Tong Wu, Huaian Chen, Jiaqi Wang, and Yi Jin. 2024 · 2024

Closest in time.