MuseTalk: Real-Time High-Fidelity Video Dubbing via Spatio-Temporal Sampling

Auto-encoding variational bayes, 2013

Diederik P Kingma, Max Welling, et al · 2013

Earlier work this paper cites.

Generative adversarial nets

Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio · 2014

Earlier work this paper cites.

Very deep convolutional networks for large-scale image recognition

Original

Karen Simonyan and Andrew Zisserman · 2014

Earlier work this paper cites.

U-net: Convolutional networks for biomedical image segmentation

Olaf Ronneberger, Philipp Fischer, and Thomas Brox · 2015

Earlier work this paper cites.

Perceptual losses for real-time style transfer and super-resolution

Justin Johnson, Alexandre Alahi, and Li Fei-Fei · 2016

Earlier work this paper cites.

Improved training of wasserstein gans

Ishaan Gulrajani, Faruk Ahmed, Martin Arjovsky, Vincent Dumoulin, and Aaron C Courville · 2017

Earlier work this paper cites.

Gans trained by a two time-scale update rule converge to a local nash equilibrium

Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter · 2017

Earlier work this paper cites.

Fixing weight decay regularization in adam

Original

Ilya Loshchilov, Frank Hutter, et al · 2017

Earlier work this paper cites.

Least squares generative adversarial networks

Xudong Mao, Qing Li, Haoran Xie, Raymond YK Lau, Zhen Wang, and Stephen Paul Smolley · 2017

Earlier work this paper cites.

Wasserstein generative adversarial networks

Martin Arjovsky, Soumith Chintala, and Léon Bottou · 2017

Earlier work this paper cites.

Lip movements generation at a glance

Lele Chen, Zhiheng Li, Ross K Maddox, Zhiyao Duan, and Chenliang Xu · 2018

Earlier work this paper cites.

Which training methods for gans do actually converge?

Lars Mescheder, Andreas Geiger, and Sebastian Nowozin · 2018

Earlier work this paper cites.

Hierarchical cross-modal talking face generation with dynamic pixel-wise loss

Lele Chen, Ross K Maddox, Zhiyao Duan, and Chenliang Xu · 2019

Earlier work this paper cites.

Arcface: Additive angular margin loss for deep face recognition

Jiankang Deng, Jia Guo, Niannan Xue, and Stefanos Zafeiriou · 2019

Earlier work this paper cites.

Talking face generation by adversarially disentangled audio-visual representation

Hang Zhou, Yu Liu, Ziwei Liu, Ping Luo, and Xiaogang Wang · 2019

Earlier work this paper cites.

wav2vec 2.0: A framework for self-supervised learning of speech representations

Alexei Baevski, Yuhao Zhou, Abdelrahman Mohamed, and Michael Auli · 2020

Earlier work this paper cites.

Speech-driven facial animation using cascaded gans for learning of motion and texture

Dipanjan Das, Sandika Biswas, Sanjana Sinha, and Brojeshwar Bhowmick · 2020

Earlier work this paper cites.

Denoising diffusion probabilistic models

Jonathan Ho, Ajay Jain, and Pieter Abbeel · 2020

Earlier work this paper cites.

A lip sync expert is all you need for speech to lip generation in the wild

KR Prajwal, Rudrabha Mukhopadhyay, Vinay P Namboodiri, and CV Jawahar · 2020

Earlier work this paper cites.

Makelttalk: speaker-aware talking-head animation

Yang Zhou, Xintong Han, Eli Shechtman, Jose Echevarria, Evangelos Kalogerakis, and Dingzeyu Li · 2020

Earlier work this paper cites.

A lip sync expert is all you need for speech to lip generation in the wild

KR Prajwal, Rudrabha Mukhopadhyay, Vinay P Namboodiri, and CV Jawahar · 2020

Cited alongside, same era.

Ad-nerf: Audio driven neural radiance fields for talking head synthesis

Yudong Guo, Keyu Chen, Sen Liang, Yong-Jin Liu, Hujun Bao, and Juyong Zhang · 2021

Cited alongside, same era.

Learned spatial representations for few-shot talking-head synthesis

Moustafa Meshry, Saksham Suri, Larry S Davis, and Abhinav Shrivastava · 2021

Cited alongside, same era.

Nerf: Representing scenes as neural radiance fields for view synthesis

Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng · 2021

Cited alongside, same era.

Towards real-world blind face restoration with generative facial prior

Xintao Wang, Yu Li, Honglun Zhang, and Ying Shan · 2021

Cited alongside, same era.

Difftalk: Crafting diffusion models for generalized audio-driven portraits animation

Shuai Shen, Wenliang Zhao, Zibin Meng, Wanhua Li, Zheng Zhu, Jie Zhou, and Jiwen Lu · 2023

Later among the works it cites.

Seeing what you said: Talking face generation guided by a lip reading expert

Jiadong Wang, Xinyuan Qian, Malu Zhang, Robby T Tan, and Haizhou Li · 2023

Later among the works it cites.

Human-computer interaction system: A survey of talking-head generation

Rui Zhen, Wenchao Song, Qiang He, Juan Cao, Lei Shi, and Jia Luo · 2023

Later among the works it cites.

Identity-preserving talking face generation with landmark and appearance priors

Weizhi Zhong, Chaowei Fang, Yinqi Cai, Pengxu Wei, Gangming Zhao, Liang Lin, and Guanbin Li · 2023

Later among the works it cites.

Echomimic: Lifelike audio-driven portrait animations through editable landmark conditions

Original

Zhiyuan Chen, Jiajiong Cao, Zhiquan Chen, Yuming Li, and Chenguang Ma · 2024

Closest in time.