Early External Safety Testing of OpenAI's o3-mini: Insights from the Pre-Deployment Evaluation

S. Segura, G. Fraser, A. B. Sanchez, and A. Ruiz-Cortés, “A survey on metamorphic testing,” IEEE Transactions on software engineering

2016

Earlier work this paper cites.

D. Ganguli, L. Lovitt, J. Kernion, A. Askell, Y. Bai, S. Kadavath, B. Mann, E. Perez, N. Schiefer, K. Ndousse, et al

Original

2022

Earlier work this paper cites.

Z. Zhang, L. Lei, L. Wu, R. Sun, Y. Huang, C. Long, X. Liu, X. Lei, J. Tang, and M. Huang, “Safetybench: Evaluating the safety of large language models with multiple choice questions,” arXiv preprint arXiv:2309.07045

Original

2023

Earlier work this paper cites.

B. Vidgen, N. Scherrer, H. R. Kirk, R. Qian, A. Kannappan, S. A. Hale, and P. Röttger, “Simplesafetytests: a test suite for identifying critical safety risks in large language models,” arXiv preprint arXiv:2311.08370

Original

2023

Earlier work this paper cites.

A. Biswas and W. Talukdar, “Guardrails for trust, safety, and ethical development and deployment of large language models (llm),” Journal of Science & Technology

2023

Earlier work this paper cites.

H. Inan, K. Upasani, J. Chi, R. Rungta, K. Iyer, Y. Mao, M. Tontchev, Q. Hu, B. Fuller, D. Testuggine, et al

Original

2023

Earlier work this paper cites.

Y. Huang, S. Gupta, M. Xia, K. Li, and D. Chen, “Catastrophic jailbreak of open-source llms via exploiting generation,” arXiv preprint arXiv:2310.06987

Original

2023

Earlier work this paper cites.

A. Zou, Z. Wang, N. Carlini, M. Nasr, J. Z. Kolter, and M. Fredrikson, “Universal and transferable adversarial attacks on aligned language models,” arXiv preprint arXiv:2307.15043

Original

2023

Earlier work this paper cites.

X. Shen, Z. Chen, M. Backes, Y. Shen, and Y. Zhang, “" do anything now": Characterizing and evaluating in-the-wild jailbreak prompts on large language models,” arXiv preprint arXiv:2308.03825

Original

2023

Earlier work this paper cites.

T. Xie, X. Qi, Y. Zeng, Y. Huang, U. M. Sehwag, K. Huang, L. He, B. Wei, D. Li, Y. Sheng, et al

Original

2024

Cited alongside, same era.

X. Yuan, J. Li, D. Wang, Y. Chen, X. Mao, L. Huang, H. Xue, W. Wang, K. Ren, and J. Wang, “S-eval: Automatic and adaptive test generation for benchmarking safety evaluation of large language models,” arXiv preprint arXiv:2405.14191

Original

2024

Cited alongside, same era.

W. Zhang, X. Lei, Z. Liu, M. An, B. Yang, K. Zhao, K. Wang, and S. Lian, “Chisafetybench: A chinese hierarchical safety benchmark for large language models,” arXiv preprint arXiv:2406.10311

Original

2024

Cited alongside, same era.

Z. Ying, A. Liu, S. Liang, L. Huang, J. Guo, W. Zhou, X. Liu, and D. Tao, “Safebench: A safety evaluation framework for multimodal large language models,” arXiv preprint arXiv:2410.18927

Original

2024

Cited alongside, same era.

[Online]

“Artificial Intelligence Act (Regulation (EU) 2024/1689), Official Journal version of 13 June 2024.” https://eur-lex.europa.eu/eli/reg/2024/1689/oj , 2024 · 2024

Later among the works it cites.

Z. Zhang, Y. Lu, J. Ma, D. Zhang, R. Li, P. Ke, H. Sun, L. Sha, Z. Sui, H. Wang, et al

Original

2024

Later among the works it cites.

A. Souly, Q. Lu, D. Bowen, T. Trinh, E. Hsieh, S. Pandey, P. Abbeel, J. Svegliato, S. Emmons, O. Watkins, et al

Original

2024

Later among the works it cites.

M. Mazeika, L. Phan, X. Yin, A. Zou, Z. Wang, N. Mu, E. Sakhaee, N. Li, S. Basart, B. Li, et al

Original

2024

Later among the works it cites.

A. Wei, N. Haghtalab, and J. Steinhardt, “Jailbroken: How does llm safety training fail?,” Advances in Neural Information Processing Systems

2024