WeQA: A Benchmark for Retrieval Augmented Generation in Wind Energy Domain

Retrieval-augmented generation for knowledge-intensive nlp tasks

Original

Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen tau Yih, Tim Rocktäschel, Sebastian Riedel, and Douwe Kiela. 2021 · 2005

Earlier work this paper cites.

Measuring massive multitask language understanding

Original

Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2020 · 2009

Earlier work this paper cites.

Mctest: A challenge dataset for the open-domain machine comprehension of text

Matthew Richardson, Christopher JC Burges, and Erin Renshaw. 2013 · 2013

Earlier work this paper cites.

Bird and bat conservation strategy for Invenergy’s pleasant ridge wind project

Invenergy. 2014 · 2014

Earlier work this paper cites.

Squad: 100,000+ questions for machine comprehension of text

Original

Pranav Rajpurkar, Jian Zhang, Konstantin Lopyrev, and Percy Liang. 2016 · 2016

Earlier work this paper cites.

Newsqa: A machine comprehension dataset

Original

Adam Trischler, Tong Wang, Xingdi Yuan, Justin Harris, Alessandro Sordoni, Philip Bachman, and Kaheer Suleman. 2016 · 2016

Earlier work this paper cites.

Searchqa: A new q&a dataset augmented with context from a search engine

Original

Matthew Dunn, Levent Sagun, Mike Higgins, V Ugur Guney, Volkan Cirik, and Kyunghyun Cho. 2017 · 2017

Earlier work this paper cites.

Triviaqa: A large scale distantly supervised challenge dataset for reading comprehension

Original

Mandar Joshi, Eunsol Choi, Daniel S Weld, and Luke Zettlemoyer. 2017 · 2017

Earlier work this paper cites.

Crowdsourcing multiple choice science questions

Original

Johannes Welbl, Nelson F Liu, and Matt Gardner. 2017 · 2017

Earlier work this paper cites.

Gender shades: Intersectional accuracy disparities in commercial gender classification

Joy Buolamwini and Timnit Gebru. 2018 · 2018

Earlier work this paper cites.

Think you have solved question answering? Try ARC, the AI2 reasoning challenge

Original

Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, and Oyvind Tafjord. 2018 · 2018

Earlier work this paper cites.

EMRQA: A large corpus for question answering on electronic medical records

Original

Anusri Pampari, Preethi Raghavan, Jennifer Liang, and Jian Peng. 2018 · 2018

Earlier work this paper cites.

BioRead: A new dataset for biomedical reading comprehension

Dimitris Pappas, Ion Androutsopoulos, and Harris Papageorgiou. 2018 · 2018

Earlier work this paper cites.

Commonsenseqa: A question answering challenge targeting commonsense knowledge

Original

Alon Talmor, Jonathan Herzig, Nicholas Lourie, and Jonathan Berant. 2018 · 2018

Earlier work this paper cites.

Glue: A multi-task benchmark and analysis platform for natural language understanding

Original

Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, and Samuel R Bowman. 2018 · 2018

Earlier work this paper cites.

Atomic: An atlas of machine commonsense for if-then reasoning

Maarten Sap, Ronan Le Bras, Emily Allaway, Chandra Bhagavatula, Nicholas Lourie, Hannah Rashkin, Brendan Roof, Noah A Smith, and Yejin Choi. 2019 · 2019

Cited alongside, same era.

BioMRC: A dataset for biomedical machine reading comprehension

Dimitris Pappas, Petros Stavropoulos, Ion Androutsopoulos, and Ryan McDonald. 2020 · 2020

Cited alongside, same era.

Beyond accuracy: Behavioral testing of NLP models with CheckList

Marco Tulio Ribeiro, Tongshuang Wu, Carlos Guestrin, and Sameer Singh. 2020 · 2020

Cited alongside, same era.

Persistent anti-muslim bias in large language models

Abubakar Abid, Maheen Farooqi, and James Zou. 2021 · 2021

Cited alongside, same era.

Towards an atlas of cultural commonsense for machine reasoning

Anurag Acharya, Kartik Talamadupula, and Mark A Finlayson. 2021 · 2021

Cited alongside, same era.

It’s time to do something: Mitigating the negative impacts of computing through a change to the peer review process

Ragas: Automated evaluation of retrieval augmented generation

Original

Shahul Es, Jithin James, Luis Espinosa-Anke, and Steven Schockaert. 2023 · 2023

Later among the works it cites.

Qasa: advanced question answering on scientific articles

Yoonjoo Lee, Kyungjae Lee, Sunghyun Park, Dasol Hwang, Jaehyeon Kim, Hong-in Lee, and Moontae Lee. 2023 · 2023

Later among the works it cites.

Rag vs. long context: Examining frontier large language models for environmental review document comprehension

Original

Hung Phan, Anurag Acharya, Sarthak Chaturvedi, Shivam Sharma, Mike Parker, Dan Nally, Ali Jannesari, Karl Pazdernik, Mahantesh Halappanavar, Sai Munikoti, et al. 2023 · 2023

Later among the works it cites.

Benchmarking, ethical alignment, and evaluation framework for conversational ai: Advancing responsible development of chatgpt

Partha Pratim Ray. 2023 · 2023

Later among the works it cites.

UNSTRUCTURED.IO

Brian Raymond. 2023 · 2023