PSCodec: A Series of High-Fidelity Low-bitrate Neural Speech Codecs Leveraging Prompt Encoders

A. W. Rix, J. G. Beerends, M. P. Hollier , et al. , “Perceptual evaluation of speech quality (pesq)-a new method for speech quality assessment of telephone networks and codecs,” in 2001 IEEE international conference on acoustics, speech, and signal processing. Proceedings (Cat. No. 01CH37221) , vol. 2. IEEE, 2001, pp. 749–752

2001

Earlier work this paper cites.

Z. Wang, A. C. Bovik, H. R. Sheikh , et al. , “Image quality assessment: from error visibility to structural similarity,” IEEE transactions on image processing , vol. 13, no. 4, pp. 600–612, 2004

2004

Earlier work this paper cites.

C. H. Taal, R. C. Hendriks, R. Heusdens , et al. , “A short-time objective intelligibility measure for time-frequency weighted noisy speech,” in 2010 IEEE international conference on acoustics, speech and signal processing . IEEE, 2010, pp. 4214–4217

2010

Earlier work this paper cites.

D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980 , 2014

Original

2014

Earlier work this paper cites.

M. Dietz, M. Multrus, V. Eksler , et al. , “Overview of the evs codec architecture,” in 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2015, pp. 5698–5702

2015

Earlier work this paper cites.

J.-M. Valin, G. Maxwell, T. B. Terriberry , et al. , “High-quality, low-delay music coding in the opus codec,” arXiv preprint arXiv:1602.04845 , 2016

Original

2016

Earlier work this paper cites.

A. Van Den Oord, S. Dieleman, H. Zen , et al. , “Wavenet: A generative model for raw audio,” arXiv preprint arXiv:1609.03499 , vol. 12, 2016

Original

2016

Earlier work this paper cites.

A. Van Den Oord, O. Vinyals , et al. , “Neural discrete representation learning,” Advances in neural information processing systems , vol. 30, 2017

2017

Earlier work this paper cites.

A. Vaswani, N. Shazeer, N. Parmar , et al. , “Attention is all you need,” Advances in neural information processing systems , vol. 30, 2017

2017

Earlier work this paper cites.

C. Gârbacea, A. van den Oord, Y. Li , et al. , “Low bit-rate speech coding with vq-vae and a wavenet decoder,” in ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2019, pp. 735–739

2019

Earlier work this paper cites.

J. Klejsa, P. Hedelin, C. Zhou , et al. , “High-quality speech coding with sample rnn,” in ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2019, pp. 7155–7159

2019

Earlier work this paper cites.

H. Zen, V. Dang, R. Clark , et al. , “Libritts: A corpus derived from librispeech for text-to-speech,” arXiv preprint arXiv:1904.02882 , 2019

Original

2019

Earlier work this paper cites.

J. Ho, A. Jain, and P. Abbeel, “Denoising diffusion probabilistic models,” Advances in neural information processing systems , vol. 33, pp. 6840–6851, 2020

2020

Earlier work this paper cites.

M. Chinen, F. S. Lim, J. Skoglund , et al. , “Visqol v3: An open source production ready objective speech and audio metric,” in 2020 twelfth international conference on quality of multimedia experience (QoMEX) . IEEE, 2020, pp. 1–6

2020

Earlier work this paper cites.

J. Kong, J. Kim, and J. Bae, “Hifi-gan: Generative adversarial networks for efficient and high fidelity speech synthesis,” Advances in neural information processing systems , vol. 33, pp. 17 022–17 033, 2020

2020

Earlier work this paper cites.

N. Zeghidour, A. Luebs, A. Omran , et al. , “Soundstream: An end-to-end neural audio codec,” IEEE/ACM Transactions on Audio, Speech, and Language Processing , vol. 30, pp. 495–507, 2021

2021

Earlier work this paper cites.

Y.-H. Chen, D.-Y. Wu, T.-H. Wu , et al. , “Again-vc: A one-shot voice conversion using activation guidance and adaptive instance normalization,” in ICASSP 2021-2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2021, pp. 5954–5958

2021

Earlier work this paper cites.

D. Wang, L. Deng, Y. T. Yeung , et al. , “Vqmivc: Vector quantization and mutual information-based unsupervised speech representation disentanglement for one-shot voice conversion,” arXiv preprint arXiv:2106.10132 , 2021

Original

2021

Earlier work this paper cites.

A. Défossez, J. Copet, G. Synnaeve , et al. , “High fidelity neural audio compression,” arXiv preprint arXiv:2210.13438 , 2022

Original

2022

Cited alongside, same era.

R. Rombach, A. Blattmann, D. Lorenz , et al. , “High-resolution image synthesis with latent diffusion models,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2022, pp. 10 684–10 695

2022

Cited alongside, same era.

T. Saeki, D. Xin, W. Nakata , et al. , “Utmos: Utokyo-sarulab system for voicemos challenge 2022,” arXiv preprint arXiv:2204.02152 , 2022

Original

2022

Cited alongside, same era.

C. Ho Chan, K. Qian, Y. Zhang , et al. , “Speechsplit2.0: Unsupervised speech disentanglement for voice conversion without tuning autoencoder bottlenecks,” in ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , 2022, pp. 6332–6336

2022

Cited alongside, same era.

Y. Pan, “Msac: Multiple speech attribute control method for speech emotion recognition,” arXiv preprint arXiv:2308.04025 , 2023

Original

2023

Later among the works it cites.

H. Wang, S. Zheng, Y. Chen , et al. , “Cam++: A fast and efficient network for speaker verification using context-aware masking,” arXiv preprint arXiv:2303.00332 , 2023

Original

2023

Later among the works it cites.

Y. Yang, Y. Pan, J. Yin , et al. , “Hybridformer: Improving squeezeformer with hybrid attention and nsr mechanism,” in ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2023, pp. 1–5

2023

Later among the works it cites.

H. Xue, X. Peng, and Y. Lu, “Low-latency speech enhancement via speech token generation,” in ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2024, pp. 661–665

2024

Closest in time.