DebateQA: Evaluating Question Answering on Debatable Knowledge

A new measure of rank correlation

Maurice G Kendall. 1938 · 1938

Earlier work this paper cites.

Comparison of the predicted and observed secondary structure of t4 phage lysozyme

Brian W Matthews. 1975 · 1975

Earlier work this paper cites.

The measurement of interrater agreement

Joseph L Fleiss, Bruce Levin, Myunghee Cho Paik, et al. 1981 · 1981

Earlier work this paper cites.

Effects of controversy on epistemic curiosity, achievement, and attitudes

Nancy Lowry and David W Johnson. 1981 · 1981

Earlier work this paper cites.

The meaning and use of the area under a receiver operating characteristic (roc) curve

James A Hanley and Barbara J McNeil. 1982 · 1982

Earlier work this paper cites.

The structural transformation of the public sphere: An inquiry into a category of bourgeois society

Jurgen Habermas. 1991 · 1991

Earlier work this paper cites.

The debate on classes , volume 20

Erik Olin Wright. 1998 · 1998

Earlier work this paper cites.

Bleu: a method for automatic evaluation of machine translation

Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002

Earlier work this paper cites.

Rouge: A package for automatic evaluation of summaries

Chin-Yew Lin. 2004 · 2004

Earlier work this paper cites.

Spearman rank correlation

Jerrold H. Zar. 2005 · 2005

Earlier work this paper cites.

Curiosity and the value of truth

Michael Brady. 2009 · 2009

Earlier work this paper cites.

Identifying controversial issues and their sub-topics in news articles

Yoonjung Choi, Yuchul Jung, and Sung-Hyon Myaeng. 2010 · 2010

Earlier work this paper cites.

Teaching about controversial issues: Rationale, practice, and need for inquiry

Thomas Misco. 2011 · 2011

Earlier work this paper cites.

Squad: 100, 000+ questions for machine comprehension of text

Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016 · 2016

Earlier work this paper cites.

From surrogacy to adoption; from bitcoin to cryptocurrency: Debate topic expansion

Roy Bar-Haim, Dalia Krieger, Orith Toledo-Ronen, Lilach Edelstein, Yonatan Bilu, Alon Halfon, Yoav Katz, Amir Menczel, Ranit Aharonov, and Noam Slonim. 2019 · 2019

Earlier work this paper cites.

ELI5: long form question answering

Angela Fan, Yacine Jernite, Ethan Perez, David Grangier, Jason Weston, and Michael Auli. 2019 · 2019

Earlier work this paper cites.

Something’s brewing! early prediction of controversy-causing posts from discussion features

Jack Hessel and Lillian Lee. 2019 · 2019

Earlier work this paper cites.

Natural questions: a benchmark for question answering research

Tom Kwiatkowski, Jennimaria Palomaki, Olivia Redfield, Michael Collins, Ankur P. Parikh, Chris Alberti, Danielle Epstein, Illia Polosukhin, Jacob Devlin, Kenton Lee, Kristina Toutanova, Llion Jones, Matthew Kelcey, Ming-Wei Chang, Andrew M. Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov. 2019 · 2019

Earlier work this paper cites.

Language models are unsupervised multitask learners

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019 · 2019

Earlier work this paper cites.

Sentence-bert: Sentence embeddings using siamese bert-networks

Nils Reimers and Iryna Gurevych. 2019 · 2019

Earlier work this paper cites.

Subjqa: A dataset for subjectivity and review comprehension

Johannes Bjerva, Nikita Bhutani, Behzad Golshan, Wang-Chiew Tan, and Isabelle Augenstein. 2020 · 2020

Earlier work this paper cites.

The curious case of neural text degeneration

Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi. 2020 · 2020

Cited alongside, same era.

Dense passage retrieval for open-domain question answering

Vladimir Karpukhin, Barlas Oguz, Sewon Min, Patrick S. H. Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen-tau Yih. 2020 · 2020

Cited alongside, same era.

BART: denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension

Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020a · 2020

Cited alongside, same era.

Retrieval-augmented generation for knowledge-intensive NLP tasks

Patrick S. H. Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, and Douwe Kiela. 2020b · 2020

Cited alongside, same era.

Ambigqa: Answering ambiguous open-domain questions

Sewon Min, Julian Michael, Hannaneh Hajishirzi, and Luke Zettlemoyer. 2020 · 2020

Cited alongside, same era.

Disentqa: Disentangling parametric and contextual knowledge with counterfactual question answering

Ella Neeman, Roee Aharoni, Or Honovich, Leshem Choshen, Idan Szpektor, and Omri Abend. 2023 · 2023

Later among the works it cites.

Direct preference optimization: Your language model is secretly a reward model

Rafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning, Stefano Ermon, and Chelsea Finn. 2023 · 2023

Later among the works it cites.

Reflexion: language agents with verbal reinforcement learning

Noah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao. 2023 · 2023

Later among the works it cites.

DELPHI: data for evaluating llms’ performance in handling controversial issues

David Q. Sun, Artem Abzaliev, Hadas Kotek, Christopher Klein, Zidi Xiu, and Jason D. Williams. 2023 · 2023

Later among the works it cites.

Llama 2: Open foundation and fine-tuned chat models

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, Dan Bikel, Lukas Blecher, Cristian Canton-Ferrer, Moya Chen, Guillem Cucurull, David Esiobu, Jude Fernandes, Jeremy Fu, Wenyin Fu, Brian Fuller, Cynthia Gao, Vedanuj Goswami, Naman Goyal, Anthony Hartshorn, Saghar Hosseini, Rui Hou, Hakan Inan, Marcin Kardas, Viktor Kerkez, Madian Khabsa, Isabel Kloumann, Artem Korenev, Punit Singh Koura, Marie-Anne Lachaux, Thibaut Lavril, Jenya Lee, Diana Liskovich, Yinghai Lu, Yuning Mao, Xavier Martinet, Todor Mihaylov, Pushkar Mishra, Igor Molybog, Yixin Nie, Andrew Poulton, Jeremy Reizenstein, Rashi Rungta, Kalyan Saladi, Alan Schelten, Ruan Silva, Eric Michael Smith, Ranjan Subramanian, Xiaoqing Ellen Tan, Binh Tang, Ross Taylor, Adina Williams, Jian Xiang Kuan, Puxin Xu, Zheng Yan, Iliyan Zarov, Yuchen Zhang, Angela Fan, Melanie Kambadur, Sharan Narang, Aurélien Rodriguez, Robert Stojnic, Sergey Edunov, and Thomas Scialom. 2023 · 2023