Red Teaming for Large Language Models At Scale: Tackling Hallucinations on Mathematics Tasks

On Faithfulness and Factuality in Abstractive Summarization

Joshua Maynez, Shashi Narayan, Bernd Bohnet, and Ryan McDonald. 2020 · 1919

Earlier work this paper cites.

A Puzzle-Based Dataset for Natural Language Inference

Original

Roxana Szomiu and Adrian Groza. 2021 · 2021

Earlier work this paper cites.

Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned

Original

Deep Ganguli, Liane Lovitt, Jackson Kernion, Amanda Askell, Yuntao Bai, Saurav Kadavath, Ben Mann, Ethan Perez, Nicholas Schiefer, Kamal Ndousse, Andy Jones, Sam Bowman, Anna Chen, Tom Conerly, Nova DasSarma, Dawn Drain, Nelson Elhage, Sheer El-Showk, Stanislav Fort, Zac Hatfield-Dodds, Tom Henighan, Danny Hernandez, Tristan Hume, Josh Jacobson, Scott Johnston, Shauna Kravec, Catherine Olsson, Sam Ringer, Eli Tran-Johnson, Dario Amodei, Tom Brown, Nicholas Joseph, Sam McCandlish, Chris Olah, Jared Kaplan, and Jack Clark. 2022 · 2022

Earlier work this paper cites.

Red Teaming Language Models with Language Models

Original

Ethan Perez, Saffron Huang, Francis Song, Trevor Cai, Roman Ring, John Aslanides, Amelia Glaese, Nat McAleese, and Geoffrey Irving. 2022 · 2022

Earlier work this paper cites.

Artificial hallucinations in ChatGPT: implications in scientific writing

Hussam Alkaissi and Samy I McFarlane. 2023 · 2023

Earlier work this paper cites.

Structured LLM Red-teaming

Leon Derczynski. 2023 · 2023

Cited alongside, same era.

Assessing Language Model Deployment with Risk Cards

Original

Leon Derczynski, Hannah Rose Kirk, Vidhisha Balachandran, Sachin Kumar, Yulia Tsvetkov, M. R. Leiser, and Saif Mohammad. 2023 · 2023

Cited alongside, same era.

Mathematical capabilities of ChatGPT

Original

Simon Frieder, Luca Pinchetti, Ryan-Rhys Griffiths, Tommaso Salvatori, Thomas Lukasiewicz, Philipp Christian Petersen, Alexis Chevalier, and Julius Berner. 2023 · 2023

Cited alongside, same era.

More than you’ve asked for: A comprehensive analysis of novel prompt injection threats to application-integrated large language models

Original

Kai Greshake, Sahar Abdelnabi, Shailesh Mishra, Christoph Endres, Thorsten Holz, and Mario Fritz. 2023 · 2023

Cited alongside, same era.

Mathprompter: Mathematical reasoning using large language models

How do you feel? measuring user-perceived value for rejecting machine decisions in hate speech detection

Philippe Lammerts, Philip Lippmann, Yen-Chia Hsu, Fabio Casati, and Jie Yang. 2023 · 2023

Closest in time.

Introduction to red teaming large language models (LLMs)

Microsoft. 2023 · 2023

Closest in time.

GPT-4 Technical Report

OpenAI. 2023 · 2023

Closest in time.

On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspective

Original

Jindong Wang, Xixu Hu, Wenxin Hou, Hao Chen, Runkai Zheng, Yidong Wang, Linyi Yang, Haojun Huang, Wei Ye, Xiubo Geng, Binxin Jiao, Yue Zhang, and Xing Xie. 2023 · 2023

Closest in time.