SC-Safety: A Multi-round Open-ended Question Adversarial Safety Benchmark for Large Language Models in Chinese

Nie, Y.; andEmily Dinan, A. W.; Bansal, M.; Weston, J.; and Kiela, D. 2020. Adversarial NLI: A New Bench- mark for Natural Language Understanding. arXiv preprint arXiv:1910.14599

Original

1910

Earlier work this paper cites.

Hendrycks, D.; Burns, C.; Basart, S.; Critch, A.; Li, J.; Song,D.; and Steinhardt, J. 2023. Aligning AI With Shared Hu- man Values. arXiv preprint arXiv:2008.02275

Original

2008

Earlier work this paper cites.

Xu, L.; Hu, H.; Zhang, X.; Li, L.; Cao, C.; Li, Y.; Xu, Y.; Sun, K.; Yu, D.; Yu, C.; Tian, Y.; Dong, Q.; Liu, W.; Shi, B.; Cui, Y.; Li, J.; Zeng, J.; Wang, R.; Xie, W.; Li, Y.; Pat- terson, Y.; Tian, Z.; Zhang, Y.; Zhou, H.; Liu, S.; Zhao, Z.; Zhao, Q.; Yue, C.; Zhang, X.; Yang, Z.; Richardson, K.; and Lan, Z. 2020. CLUE: A Chinese Language Understanding Evaluation Benchmark. In Proceedings of the 28th Inter- national Conference on Computational Linguistics, 4762– 4772. Barcelona, Spain (Online): International Committee on Computational Linguistics

2020

Earlier work this paper cites.

Bommasani, R.; Hudson, D. A.; Adeli, E.; Altman, R.; Arora, S.; Sydney von Arx.., Y. Z.; Zheng, L.; Zhou, K.; and Liang, P. 2022. On the Opportunities and Risks of Founda- tion Models. arXiv preprint arXiv:2108.07258

Original

2022

Cited alongside, same era.

OpenAI. 2023. GPT-4 Technical Report. arXiv:2303.08774

Original

2023

Cited alongside, same era.

Zheng, L.; Chiang, W.-L.; Sheng, Y.; Zhuang, S.; Wu, Z.; Zhuang, Y.; Lin, Z.; Li, Z.; Li, D.; Xing, E. P.; Zhang, H.; Gonzalez, J. E.; and Stoica, I. 2023. Judg- ing LLM-as-a-judge with MT-Bench and Chatbot Arena. arXiv:2306.05685

Original

2023

Cited alongside, same era.

Xu, L.; Li, A.; Zhu, L.; Xue, H.; Zhu, C.; Zhao, K.; He, H.; Zhang, X.; Kang, Q.; and Lan, Z. 2023b. SuperCLUE: A Comprehensive Chinese Large Language Model Bench- mark. arXiv preprint arXiv:2307.15020

Original

Cited in the paper.

Huang, Y.; Bai, Y.; Zhu, Z.; Zhang, J.; Zhang, J.; Su, T.; Liu, J.; Lv, C.; Zhang, Y.; Lei, J.; Fu, Y.; Sun, M.; and He, J. 2023. C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models. arXiv preprint arXiv:2305.08322

Original

2023

Closest in time.

Sun, H.; Zhang, Z.; Deng, J.; Cheng, J.; and Huang, M. 2023. Safety Assessment of Chinese Large Language Mod- els. arXiv preprint arXiv:2304.10436

Original

2023

Closest in time.

Zhang, Z.; Lei, L.; Wu, L.; Sun, R.; Huang, Y.; Long, C.; Liu, X.; Lei, X.; Tang, J.; and Huang, M. 2023. SafetyBench: Evaluating the Safety of Large Language Models with Multiple Choice Questions. arXiv preprint arXiv:2309.07045

Original

2023

Closest in time.