Detecting music deepfakes is easy but actually hard

N. Tishby, F. C. Pereira, and W. Bialek, “The information bottleneck method,” 37th annual Allerton Conference on Communication, Control, and Computing , 2000

2000

Earlier work this paper cites.

T. Lombrozo, “The structure and function of explanations,” Trends in cognitive sciences , vol. 10, no. 10, pp. 464–470, 2006

2006

Earlier work this paper cites.

C. Szegedy, W. Zaremba, I. Sutskever, J. Bruna, D. Erhan, I. Goodfellow, and R. Fergus, “Intriguing properties of neural networks,” arXiv preprint arXiv:1312.6199 , 2013

Original

2013

Earlier work this paper cites.

A. Nguyen, J. Yosinski, and J. Clune, “Deep neural networks are easily fooled: High confidence predictions for unrecognizable images,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2015, pp. 427–436

2015

Earlier work this paper cites.

A. Van Den Oord, S. Dieleman, H. Zen, K. Simonyan, O. Vinyals, A. Graves, N. Kalchbrenner, A. Senior, K. Kavukcuoglu et al. , “Wavenet: A generative model for raw audio,” arXiv preprint arXiv:1609.03499 , vol. 12, 2016

Original

2016

Earlier work this paper cites.

Z. Wu, J. Yamagishi, T. Kinnunen, C. Hanilçi, M. Sahidullah, A. Sizov, N. Evans, M. Todisco, and H. Delgado, “Asvspoof: the automatic speaker verification spoofing and countermeasures challenge,” IEEE Journal of Selected Topics in Signal Processing , vol. 11, no. 4, pp. 588–604, 2017

2017

Earlier work this paper cites.

J. Peters, D. Janzing, and B. Schölkopf, Elements of causal inference: foundations and learning algorithms . The MIT Press, 2017

2017

Earlier work this paper cites.

C. Guo, G. Pleiss, Y. Sun, and K. Q. Weinberger, “On calibration of modern neural networks,” in International conference on machine learning . PMLR, 2017, pp. 1321–1330

2017

Earlier work this paper cites.

D. Afchar, V. Nozick, J. Yamagishi, and I. Echizen, “Mesonet: a compact facial video forgery detection network,” in 2018 IEEE international workshop on information forensics and security (WIFS) . IEEE, 2018, pp. 1–7

2018

Earlier work this paper cites.

M. Defferrard, S. P. Mohanty, S. F. Carroll, and M. Salathé, “Learning to recognize musical genre from audio,” in The 2018 Web Conference Companion . ACM Press, 2018. [Online]. Available: https://arxiv.org/abs/1803.05337

Original

2018

Earlier work this paper cites.

B. Kim, M. Wattenberg, J. Gilmer, C. Cai, J. Wexler, F. Viegas, and R. sayres, “Interpretability beyond feature attribution: Quantitative testing with concept activation vectors (TCAV),” in International Conference on Machine Learning (ICML) . PMLR, 2018, pp. 2668–2677

2018

Earlier work this paper cites.

A. Rossler, D. Cozzolino, L. Verdoliva, C. Riess, J. Thies, and M. Nießner, “Faceforensics++: Learning to detect manipulated facial images,” in Proceedings of the IEEE/CVF international conference on computer vision , 2019, pp. 1–11

2019

Earlier work this paper cites.

K. Kumar, R. Kumar, T. De Boissiere, L. Gestin, W. Z. Teoh, J. Sotelo, A. De Brebisson, Y. Bengio, and A. C. Courville, “Melgan: Generative adversarial networks for conditional waveform synthesis,” Advances in neural information processing systems , vol. 32, 2019

2019

Earlier work this paper cites.

A. Razavi, A. Van den Oord, and O. Vinyals, “Generating diverse high-fidelity images with vq-vae-2,” Advances in neural information processing systems , vol. 32, 2019

2019

Earlier work this paper cites.

J. Kong, J. Kim, and J. Bae, “Hifi-gan: Generative adversarial networks for efficient and high fidelity speech synthesis,” Advances in neural information processing systems , vol. 33, pp. 17 022–17 033, 2020

2020

Earlier work this paper cites.

P. Dhariwal, H. Jun, C. Payne, J. W. Kim, A. Radford, and I. Sutskever, “Jukebox: A generative model for music,” arXiv preprint arXiv:2005.00341 , 2020

Original

2020

Earlier work this paper cites.

S.-Y. Wang, O. Wang, R. Zhang, A. Owens, and A. A. Efros, “Cnn-generated images are surprisingly easy to spot… for now,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2020, pp. 8695–8704

2020

Earlier work this paper cites.

Y. Li, X. Yang, P. Sun, H. Qi, and S. Lyu, “Celeb-df: A large-scale challenging dataset for deepfake forensics,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2020, pp. 3207–3216

2020

Earlier work this paper cites.

E. M. Bender, T. Gebru, A. McMillan-Major, and S. Shmitchell, “On the dangers of stochastic parrots: Can language models be too big?” in Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency , ser. FAccT ’21. ACM, 2021, p. 610–623. [Online]. Available: https://doi.org/10.1145/3442188.3445922

2021

Earlier work this paper cites.

K. Crawford, The atlas of AI: Power, politics, and the planetary costs of artificial intelligence . Yale University Press, 2021

2021

Earlier work this paper cites.

Y. Mirsky and W. Lee, “The creation and detection of deepfakes: A survey,” ACM computing surveys (CSUR) , vol. 54, no. 1, pp. 1–41, 2021

2021

Cited alongside, same era.

N. Zeghidour, A. Luebs, A. Omran, J. Skoglund, and M. Tagliasacchi, “Soundstream: An end-to-end neural audio codec,” IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol. 30, pp. 495–507, 2021

2021

Cited alongside, same era.

L. Scimeca, S. J. Oh, S. Chun, M. Poli, and S. Yun, “Which shortcut cues will dnns choose? a study from the parameter-space perspective,” in International Conference on Learning Representations , 2021

2021

Cited alongside, same era.

D. Das, P. van Boheemen, N. Linda, J. Jahnel, M. Karaboga, M. Fatun, and M. Huijstee, “Tackling deepfakes in european policy,” European Parliament, Tech. Rep., 07 2021

2021

Cited alongside, same era.

D. Yang, J. Yu, H. Wang, W. Wang, C. Weng, Y. Zou, and D. Yu, “Diffsound: Discrete diffusion model for text-to-sound generation,” IEEE/ACM Transactions on Audio, Speech, and Language Processing , 2023

2023

Later among the works it cites.

H. F. Garcia, P. Seetharaman, R. Kumar, and B. Pardo, “Vampnet: Music generation via masked acoustic token modeling,” arXiv preprint arXiv:2307.04686 , 2023

Original

2023

Later among the works it cites.

Ars Technica, “Why ai detectors think the us constitution was written by ai,” https://arstechnica.com/information-technology/2023/07/why-ai-detectors-think-the-us-constitution-was-written-by-ai/

2023

Later among the works it cites.

T. Miller, “Explainable ai is dead, long live explainable ai! hypothesis-driven decision support using evaluative ai,” in ACM Conference on Fairness, Accountability, and Transparency (FAccT) , ser. FAccT ’23. ACM, 2023, p. 333–342. [Online]. Available: https://doi.org/10.1145/3593013.3594001

2023