DiffAVA: Personalized Text-to-Audio Generation with Visual Alignment

Self-supervised generation of spatial audio for 360°video

Pedro Morgado, Nuno Nvasconcelos, Timothy Langlois, and Oliver Wang · 2018

Earlier work this paper cites.

Audio-visual event localization in unconstrained videos

Yapeng Tian, Jing Shi, Bochen Li, Zhiyao Duan, and Chenliang Xu · 2018

Earlier work this paper cites.

AudioCaps: Generating captions for audios in the wild

Chris Dongjoo Kim, Byeongchang Kim, Hyunmin Lee, and Gunhee Kim · 2019

Earlier work this paper cites.

Denoising diffusion probabilistic models

Jonathan Ho, Ajay Jain, and Pieter Abbeel · 2020

Earlier work this paper cites.

Learning representations from audio-visual spatial alignment

Pedro Morgado, Yi Li, and Nuno Nvasconcelos · 2020

Earlier work this paper cites.

Unified multisensory perception: Weakly-supervised audio-visual video parsing

Yapeng Tian, Dingzeyu Li, and Chenliang Xu · 2020

Earlier work this paper cites.

Diffwave: A versatile diffusion model for audio synthesis

Zhifeng Kong, Wei Ping, Jiaji Huang, Kexin Zhao, and Bryan Catanzaro · 2021

Earlier work this paper cites.

Image super-resolution via iterative refinement

Original

Chitwan Saharia, Jonathan Ho, William Chan, Tim Salimans, David J. Fleet, and Mohammad Norouzi · 2021

Cited alongside, same era.

Score-based generative modeling through stochastic differential equations

Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole · 2021

Cited alongside, same era.

Imagen video: High definition video generation with diffusion models

Original

Jonathan Ho, William Chan, Chitwan Saharia, Jay Whang, Ruiqi Gao, Alexey Gritsenko, Diederik P. Kingma, Ben Poole, Mohammad Norouzi, David J. Fleet, and Tim Salimans · 2022

Cited alongside, same era.

X-clip: End-to-end multi-grained contrastive learning for video-text retrieval

Yiwei Ma, Guohai Xu, Xiaoshuai Sun, Ming Yan, Ji Zhang, and Rongrong Ji · 2022

Cited alongside, same era.

A closer look at weakly-supervised audio-visual source localization

Shentong Mo and Pedro Morgado · 2022

Photorealistic text-to-image diffusion models with deep language understanding

Original

Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily Denton, Seyed Kamyar Seyed Ghasemipour, Burcu Karagol Ayan, S. Sara Mahdavi, Rapha Gontijo Lopes, Tim Salimans, Jonathan Ho, David J Fleet, and Mohammad Norouzi · 2022

Later among the works it cites.

Diffsound: Discrete diffusion model for text-to-sound generation

Original

Dongchao Yang, Jianwei Yu, Helin Wang, Wen Wang, Chao Weng, Yuexian Zou, and Dong Yu · 2022

Later among the works it cites.

Audiogen: Textually guided audio generation

Felix Kreuk, Gabriel Synnaeve, Adam Polyak, Uriel Singer, Alexandre Défossez, Jade Copet, Devi Parikh, Yaniv Taigman, and Yossi Adi · 2023

Closest in time.

Audioldm: Text-to-audio generation with latent diffusion models

Original

Haohe Liu, Zehua Chen, Yi Yuan, Xinhao Mei, Xubo Liu, Danilo Mandic, Wenwu Wang, and Mark D. Plumbley · 2023

Closest in time.