Localizing Lying in Llama: Understanding Instructed Dishonesty on True-False Questions Through Prompting, Probing, and Patching

Discovering latent knowledge in language models without supervision, 2022

Collin Burns, Haotian Ye, Dan Klein, and Jacob Steinhardt · 2022

Earlier work this paper cites.

TruthfulQA: Measuring how models mimic human falsehoods, 2022

Stephanie Lin, Jacob Hilton, and Owain Evans · 2022

Earlier work this paper cites.

Interpretability in the wild: a circuit for indirect object identification in GPT-2 small, 2022

Kevin Wang, Alexandre Variengien, Arthur Conmy, Buck Shlegeris, and Jacob Steinhardt · 2022

Earlier work this paper cites.

The internal state of an LLM knows when it’s lying, 2023

Amos Azaria and Tom Mitchell · 2023

Earlier work this paper cites.

LEACE: Perfect linear concept erasure in closed form, 2023

Nora Belrose, David Schneider-Joseph, Shauli Ravfogel, Ryan Cotterell, Edward Raff, and Stella Biderman · 2023

Earlier work this paper cites.

Sparks of artificial general intelligence: Early experiments with gpt-4, 2023

Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, Harsha Nori, Hamid Palangi, Marco Tulio Ribeiro, and Yi Zhang · 2023

Earlier work this paper cites.

Finding neurons in a haystack: Case studies with sparse probing, 2023

Wes Gurnee, Neel Nanda, Matthew Pauly, Katherine Harvey, Dmitrii Troitskii, and Dimitris Bertsimas · 2023

Cited alongside, same era.

Overthinking the truth: Understanding how language models process false demonstrations, 2023

Danny Halawi, Jean-Stanislas Denain, and Jacob Steinhardt · 2023

Cited alongside, same era.

An overview of catastrophic AI risks, 2023

Dan Hendrycks, Mantas Mazeika, and Thomas Woodside · 2023

Cited alongside, same era.

Still no lie detector for language models: Probing empirical and conceptual roadblocks, 2023

B. A. Levinstein and Daniel A. Herrmann · 2023

Cited alongside, same era.

Inference-time intervention: Eliciting truthful answers from a language model, 2023

Kenneth Li, Oam Patel, Fernanda Viégas, Hanspeter Pfister, and Martin Wattenberg · 2023

Cited alongside, same era.

Locating and editing factual associations in GPT, 2023

Kevin Meng, David Bau, Alex Andonian, and Yonatan Belinkov · 2023

Closest in time.

How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions, 2023

Lorenzo Pacchiardi, Alex J. Chan, Sören Mindermann, Ilan Moscovitz, Alexa Y. Pan, Yarin Gal, Owain Evans, and Jan Brauner · 2023

Closest in time.

AI deception: A survey of examples, risks, and potential solutions, 2023

Peter S. Park, Simon Goldstein, Aidan O’Gara, Michael Chen, and Dan Hendrycks · 2023

Closest in time.

Llama 2: Open foundation and fine-tuned chat models, 2023

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurelien Rodriguez, Robert Stojnic, Sergey Edunov, and Thomas Scialom · 2023