On Measuring Faithfulness or Self-consistency of Natural Language Explanations

Harvey Friedman’s research on the foundations of mathematics

Leo A Harrington, Michael D Morley, A Šcedrov, and Stephen G Simpson. 1985 · 1985

Earlier work this paper cites.

Wt5?! training text-to-text models to explain their predictions

Original

Sharan Narang, Colin Raffel, Katherine Lee, Adam Roberts, Noah Fiedel, and Karishma Malkan. 2020 · 2004

Earlier work this paper cites.

Layer-wise relevance propagation for neural networks with local renormalization layers

Alexander Binder, Grégoire Montavon, Sebastian Lapuschkin, Klaus-Robert Müller, and Wojciech Samek. 2016 · 2016

Earlier work this paper cites.

" why should i trust you?" explaining the predictions of any classifier

Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016 · 2016

Earlier work this paper cites.

A unified approach to interpreting model predictions

Scott M Lundberg and Su-In Lee. 2017 · 2017

Earlier work this paper cites.

Axiomatic attribution for deep networks

Mukund Sundararajan, Ankur Taly, and Qiqi Yan. 2017 · 2017

Earlier work this paper cites.

e-snli: Natural language inference with natural language explanations

Oana-Maria Camburu, Tim Rocktäschel, Thomas Lukasiewicz, and Phil Blunsom. 2018 · 2018

Earlier work this paper cites.

RISE: randomized input sampling for explanation of black-box models

Original

Vitali Petsiuk, Abir Das, and Kate Saenko. 2018 · 2018

Earlier work this paper cites.

Don’t take the premise for granted: Mitigating artifacts in natural language inference

Yonatan Belinkov, Adam Poliak, Stuart Shieber, Benjamin Van Durme, and Alexander Rush. 2019 · 2019

Earlier work this paper cites.

Attention is not Explanation

Sarthak Jain and Byron C. Wallace. 2019 · 2019

Earlier work this paper cites.

Language models are unsupervised multitask learners

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019 · 2019

Earlier work this paper cites.

Explain yourself! leveraging language models for commonsense reasoning

Nazneen Fatema Rajani, Bryan McCann, Caiming Xiong, and Richard Socher. 2019 · 2019

Earlier work this paper cites.

Is attention interpretable?

Sofia Serrano and Noah A. Smith. 2019 · 2019

Earlier work this paper cites.

Attention is not not explanation

Sarah Wiegreffe and Yuval Pinter. 2019 · 2019

Earlier work this paper cites.

Rethinking cooperative rationalization: Introspective extraction and complement control

Mo Yu, Shiyu Chang, Yang Zhang, and Tommi Jaakkola. 2019 · 2019

Earlier work this paper cites.

Towards faithfully interpretable NLP systems: How should we define and evaluate faithfulness?

Alon Jacovi and Yoav Goldberg. 2020 · 2020

Earlier work this paper cites.

SemEval-2020 task 4: Commonsense validation and explanation

Cunxiang Wang, Shuailong Liang, Yili Jin, Yilong Wang, Xiaodan Zhu, and Yue Zhang. 2020 · 2020

Earlier work this paper cites.

Evaluating large language models trained on code

Original

Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al. 2021 · 2021

Earlier work this paper cites.

Measuring association between labels and free-text rationales

Sarah Wiegreffe, Ana Marasović, and Noah A. Smith. 2021 · 2021

Earlier work this paper cites.

Fact checking with insufficient evidence

Pepa Atanasova, Jakob Grue Simonsen, Christina Lioma, and Isabelle Augenstein. 2022 · 2022

Cited alongside, same era.

Selection-inference: Exploiting large language models for interpretable logical reasoning

Original

Antonia Creswell, Murray Shanahan, and Irina Higgins. 2022 · 2022

Cited alongside, same era.

Gender artifacts in visual datasets

Original

Nicole Meister, Dora Zhao, Angelina Wang, Vikram V Ramaswamy, Ruth Fong, and Olga Russakovsky. 2022 · 2022

Cited alongside, same era.

Rethinking the role of demonstrations: What makes in-context learning work?

Sewon Min, Xinxi Lyu, Ari Holtzman, Mikel Artetxe, Mike Lewis, Hannaneh Hajishirzi, and Luke Zettlemoyer. 2022 · 2022

Cited alongside, same era.

Interpretable Machine Learning , 2 edition

Christoph Molnar. 2022 · 2022

Cited alongside, same era.

Gpt-4 technical report

Original

OpenAI. 2023 · 2023

Closest in time.

The refinedweb dataset for falcon llm: outperforming curated corpora with web data, and web data only

Original

Guilherme Penedo, Quentin Malartic, Daniel Hesslow, Ruxandra Cojocaru, Alessandro Cappelli, Hamza Alobeidli, Baptiste Pannier, Ebtesam Almazrouei, and Julien Launay. 2023 · 2023

Closest in time.

Discovering language model behaviors with model-written evaluations

Ethan Perez, Sam Ringer, Kamile Lukosiute, Karina Nguyen, Edwin Chen, Scott Heiner, Craig Pettit, Catherine Olsson, Sandipan Kundu, Saurav Kadavath, Andy Jones, Anna Chen, Benjamin Mann, Brian Israel, Bryan Seethor, Cameron McKinnon, Christopher Olah, Da Yan, Daniela Amodei, Dario Amodei, Dawn Drain, Dustin Li, Eli Tran-Johnson, Guro Khundadze, Jackson Kernion, James Landis, Jamie Kerr, Jared Mueller, Jeeyoon Hyun, Joshua Landau, Kamal Ndousse, Landon Goldberg, Liane Lovitt, Martin Lucas, Michael Sellitto, Miranda Zhang, Neerav Kingsland, Nelson Elhage, Nicholas Joseph, Noemi Mercado, Nova DasSarma, Oliver Rausch, Robin Larson, Sam McCandlish, Scott Johnston, Shauna Kravec, Sheer El Showk, Tamera Lanham, Timothy Telleen-Lawton, Tom Brown, Tom Henighan, Tristan Hume, Yuntao Bai, Zac Hatfield-Dodds, Jack Clark, Samuel R. Bowman, Amanda Askell, Roger Grosse, Danny Hernandez, Deep Ganguli, Evan Hubinger, Nicholas Schiefer, and Jared Kaplan. 2023 · 2023

Closest in time.