Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answering

J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms,” arXiv preprint arXiv:1707.06347 , 2017

Original

2017

Earlier work this paper cites.

E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen, “LoRA: Low-rank adaptation of large language models,” arXiv preprint arXiv:2106.09685 , 2021

Original

2021

Earlier work this paper cites.

P. Yang, X. Wang, X. Duan, H. Chen, R. Hou, C. Jin, and W. Zhu, “AVQA: A dataset for audio-visual question answering on videos,” in Proceedings of the 30th ACM International Conference on Multimedia , ser. MM ’22, 2022, p. 3480–3491

2022

Earlier work this paper cites.

C. Tang, W. Yu, G. Sun, X. Chen, T. Tan, W. Li, L. Lu, Z. Ma, and C. Zhang, “SALMONN: Towards generic hearing abilities for large language models,” arXiv preprint arXiv:2310.13289 , 2023

Original

2023

Earlier work this paper cites.

Y. Chu, J. Xu, Q. Yang, H. Wei, X. Wei, Z. Guo, Y. Leng, Y. Lv, J. He, J. Lin, C. Zhou, and J. Zhou, “Qwen2-Audio technical report,” arXiv preprint arXiv:2407.10759 , 2024

Original

2024

Earlier work this paper cites.

S. Sakshi, U. Tyagi, S. Kumar, A. Seth, R. Selvakumar, O. Nieto, R. Duraiswami, S. Ghosh, and D. Manocha, “MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark,” arXiv preprint arXiv:2410.19168 , 2024

Original

2024

Earlier work this paper cites.

Z. Shao, P. Wang, Q. Zhu, R. Xu, J. Song, X. Bi, H. Zhang, M. Zhang, Y. K. Li, Y. Wu, and D. Guo, “Deepseekmath: Pushing the limits of mathematical reasoning in open language models,” 2402.03300 , 2024

2024

Earlier work this paper cites.

J. Kim, J. Jung, M. Jeon, S. H. Woo, and J. Lee, “Expanding on EnCLAP with auxiliary retrieval model for automated audio captioning,” DCASE2024 Challenge, Tech. Rep. 108, May 2024

2024

Earlier work this paper cites.

J. Kim, M. Jeon, J. Jung, S. H. Woo, and J. Lee, “EnCLAP++: Analyzing the EnCLAP Framework for Optimizing Automated Audio Captioning Performance,” arXiv preprint arXiv:2409.01201 , 2024

Original

2024

Cited alongside, same era.

W. Chen, X. Li, Z. Ma, Y. Liang, A. Jiang, Z. Zheng, Y. Qian, P. Fan, W.-Q. Zhang, C. Lu, J. Liu, and X. Chen, “SJTU-THU Automated Audio Captioning System for DCASE 2024,” DCASE2024 Challenge, Tech. Rep. 2, May 2024

2024

Cited alongside, same era.

J. Liu, G. Li, C. Liu, J. Zhang, H. Dinkel, Y. Wang, Z. Yan, Y. Wang, and B. Wang, “Leveraging CED encoder and large language models for automated audio captioning,” DCASE2024 Challenge, Tech. Rep. 42, May 2024

2024

Cited alongside, same era.

J. Liu, G. Li, J. Zhang, H. Dinkel, Y. Wang, Z. Yan, Y. Wang, and B. Wang, “Enhancing automated audio captioning via large language models with optimized audio encoding,” in Interspeech 2024 , 2024, pp. 1135–1139

2024

Cited alongside, same era.

H. Zhou, X. Li, R. Wang, M. Cheng, T. Zhou, and C.-J. Hsieh, “R1-Zero’s "Aha Moment" in Visual Reasoning on a 2B Non-SFT Model,” arXiv preprint arXiv:2503.05132 , 2025

Original

2025

Closest in time.

G. Xu, P. Jin, H. Li, Y. Song, L. Sun, and L. Yuan, “LLaVA-CoT: Let vision language models reason step-by-step,” arXiv preprint arXiv:2411.10440 , 2025

Original

2025

Closest in time.

S. Ghosh, Z. Kong, S. Kumar, S. Sakshi, J. Kim, W. Ping, R. Valle, D. Manocha, and B. Catanzaro, “Audio Flamingo 2: An audio-language model with long-audio understanding and expert reasoning abilities,” 2025

2025

Closest in time.

Z. Xie, M. Lin, Z. Liu, P. Wu, S. Yan, and C. Miao, “Audio-reasoner: Improving reasoning capability in large audio language models,” arXiv preprint arXiv:2503.02318 , 2025

Original

2025

Closest in time.