SEE-2-SOUND: Zero-Shot Spatial Environment-to-Spatial Sound

Periphony: With-height sound reproduction

Michael A Gerzon. 1973 · 1973

Earlier work this paper cites.

Local sound field reproduction using digital signal processing

Ole Kirkeby, Philip A Nelson, Felipe Orduna-Bustamante, and Hareo Hamada. 1996 · 1996

Earlier work this paper cites.

Towards optimal soundfield representation. In Audio Engineering Society Convention 106 . Audio Engineering Society

Glenn Dickins and Rodney Kennedy. 1999 · 1999

Earlier work this paper cites.

Expressive sonification of footstep sounds

Roberto Bresin, Anna de Witt, Stefano Papetti, Marco Civolani, and Federico Fontana. 2010 · 2010

Earlier work this paper cites.

Multichannel stereophonic sound system with and without accompanying picture

BS Series. 2010 · 2010

Earlier work this paper cites.

Spatial sound for computer games and virtual reality

David Murphy and Flaithrí Neff. 2011 · 2011

Earlier work this paper cites.

Spatial audio

Francis Rumsey. 2012 · 2012

Earlier work this paper cites.

Auto-encoding variational bayes

Original

Diederik P Kingma and Max Welling. 2013 · 2013

Earlier work this paper cites.

Microsoft coco: Common objects in context. In Computer vision–ECCV 2014: 13th European conference, zurich, Switzerland, September 6-12, 2014, proceedings, part v 13 . Springer, 740–755

Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick. 2014 · 2014

Earlier work this paper cites.

Soundnet: Learning sound representations from unlabeled video

Yusuf Aytar, Carl Vondrick, and Antonio Torralba. 2016 · 2016

Earlier work this paper cites.

Temporal multimodal learning in audiovisual speech recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . 3574–3582

Di Hu, Xuelong Li, et al · 2016

Earlier work this paper cites.

Ambient sound provides supervision for visual learning. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part I 14 . Springer, 801–816

Andrew Owens, Jiajun Wu, Josh H McDermott, William T Freeman, and Antonio Torralba. 2016 · 2016

Earlier work this paper cites.

WaveNet: A Generative Model for Raw Audio. In Arxiv

Original

Aäron van den Oord, Sander Dieleman, Heiga Zen, Karen Simonyan, Oriol Vinyals, Alexander Graves, Nal Kalchbrenner, Andrew Senior, and Koray Kavukcuoglu. 2016 · 2016

Earlier work this paper cites.

Look, listen and learn. In Proceedings of the IEEE international conference on computer vision . 609–617

Relja Arandjelovic and Andrew Zisserman. 2017 · 2017

Earlier work this paper cites.

See, hear, and read: Deep aligned representations

Original

Yusuf Aytar, Carl Vondrick, and Antonio Torralba. 2017 · 2017

Earlier work this paper cites.

Lip reading sentences in the wild. In Proceedings of the IEEE conference on computer vision and pattern recognition . 6447–6456

Joon Son Chung, Andrew Senior, Oriol Vinyals, and Andrew Zisserman. 2017 · 2017

Earlier work this paper cites.

Neural discrete representation learning

Aaron Van Den Oord, Oriol Vinyals, et al · 2017

Earlier work this paper cites.

Attention is All you Need. In Advances in Neural Information Processing Systems , I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.), Vol. 30. Curran Associates, Inc

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

Surround by sound: A review of spatial audio recording and reproduction

Wen Zhang, Parasanga N Samarasinghe, Hanchi Chen, and Thushara D Abhayapala. 2017 · 2017

Earlier work this paper cites.

Objects that sound. In Proceedings of the European conference on computer vision (ECCV) . 435–451

Relja Arandjelovic and Andrew Zisserman. 2018 · 2018

Earlier work this paper cites.

The importance of spatial audio in modern games and virtual environments. In 2018 IEEE Games, Entertainment, Media Conference (GEM) . IEEE, 1–9

James Broderick, Jim Duggan, and Sam Redfern. 2018 · 2018

Earlier work this paper cites.

Scene-aware audio for 360 videos

Dingzeyu Li, Timothy R Langlois, and Changxi Zheng. 2018 · 2018

Earlier work this paper cites.

Self-Supervised Generation of Spatial Audio for 360 deg \deg Video. In Advances in Neural Information Processing Systems , Vol. 31

Pedro Morgado, Nuno Nvasconcelos, Timothy Langlois, and Oliver Wang. 2018 · 2018

Earlier work this paper cites.

Audio-visual scene analysis with self-supervised multisensory features. In Proceedings of the European conference on computer vision (ECCV) . 631–648

Andrew Owens and Alexei A Efros. 2018 · 2018

Earlier work this paper cites.

Pyroomacoustics: A python package for audio room simulation and array processing algorithms. In 2018 IEEE international conference on acoustics, speech and signal processing (ICASSP) . IEEE, 351–355

Robin Scheibler, Eric Bezzam, and Ivan Dokmanić. 2018 · 2018

Earlier work this paper cites.

Learning to localize sound source in visual scenes. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . 4358–4366

Arda Senocak, Tae-Hyun Oh, Junsik Kim, Ming-Hsuan Yang, and In So Kweon. 2018 · 2018

Earlier work this paper cites.

Audio-visual event localization in unconstrained videos. In Proceedings of the European conference on computer vision (ECCV) . 247–263

Yapeng Tian, Jing Shi, Bochen Li, Zhiyao Duan, and Chenliang Xu. 2018 · 2018

Earlier work this paper cites.

The sound of pixels. In Proceedings of the European conference on computer vision (ECCV) . 570–586

Hang Zhao, Chuang Gan, Andrew Rouditchenko, Carl Vondrick, Josh McDermott, and Antonio Torralba. 2018 · 2018

Earlier work this paper cites.

Visual to sound: Generating natural sound for videos in the wild. In Proceedings of the IEEE conference on computer vision and pattern recognition . 3550–3558

Yipin Zhou, Zhaowen Wang, Chen Fang, Trung Bui, and Tamara L Berg. 2018 · 2018

Earlier work this paper cites.

Self-supervised moving vehicle tracking with stereo sound. In Proceedings of the IEEE/CVF international conference on computer vision . 7053–7062

Chuang Gan, Hang Zhao, Peihao Chen, David Cox, and Antonio Torralba. 2019 · 2019

Cited alongside, same era.

2.5 d visual sound. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . 324–333

Ruohan Gao and Kristen Grauman. 2019 · 2019

Cited alongside, same era.

Language Models are Unsupervised Multitask Learners

Alec Radford, Jeff Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019

Cited alongside, same era.

Self-supervised audio-visual co-segmentation. In ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2357–2361

Andrew Rouditchenko, Hang Zhao, Chuang Gan, Josh McDermott, and Antonio Torralba. 2019 · 2019

Cited alongside, same era.

Dual attention matching for audio-visual event localization. In Proceedings of the IEEE/CVF international conference on computer vision . 6292–6300

Noise2music: Text-conditioned music generation with diffusion models

Original

Qingqing Huang, Daniel S Park, Tao Wang, Timo I Denk, Andy Ly, Nanxin Chen, Zhengdong Zhang, Zhishuai Zhang, Jiahui Yu, Christian Frank, et al · 2023

Later among the works it cites.

Segment Anything. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV) . 4015–4026

Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C. Berg, Wan-Yen Lo, Piotr Dollar, and Ross Girshick. 2023 · 2023

Later among the works it cites.

AudioGen: Textually Guided Audio Generation. In The Eleventh International Conference on Learning Representations

Felix Kreuk, Gabriel Synnaeve, Adam Polyak, Uriel Singer, Alexandre Défossez, Jade Copet, Devi Parikh, Yaniv Taigman, and Yossi Adi. 2023 · 2023

Later among the works it cites.

Magic3D: High-Resolution Text-to-3D Content Creation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) . 300–309

Chen-Hsuan Lin, Jun Gao, Luming Tang, Towaki Takikawa, Xiaohui Zeng, Xun Huang, Karsten Kreis, Sanja Fidler, Ming-Yu Liu, and Tsung-Yi Lin. 2023 · 2023

Later among the works it cites.