SemEval-2024 Task 9: BRAINTEASER: A Novel Task Defying Common Sense

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 1901

Earlier work this paper cites.

Zero shot is all you need at semeval-2024 task 9: A study of state of the art llms on lateral thinking puzzles

Erfan Moosavi Monazzah and Mahdi Feghhi. 2024 · 1905

Earlier work this paper cites.

Roberta: A robustly optimized bert pretraining approach

Original

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907

Earlier work this paper cites.

Wordnet: a lexical database for english

George A Miller. 1995 · 1995

Earlier work this paper cites.

On improving the accuracy of readability classification using insights from second language acquisition

Sowmya Vajjala and Detmar Meurers. 2012 · 2012

Earlier work this paper cites.

Conceptnet 5.5: An open multilingual graph of general knowledge

Robyn Speer, Joshua Chin, and Catherine Havasi. 2017 · 2017

Earlier work this paper cites.

Bert: Pre-training of deep bidirectional transformers for language understanding

Original

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018 · 2018

Earlier work this paper cites.

Social iqa: Commonsense reasoning about social interactions

Maarten Sap, Hannah Rashkin, Derek Chen, Ronan Le Bras, and Yejin Choi. 2019b · 2019

Earlier work this paper cites.

Commonsenseqa: A question answering challenge targeting commonsense knowledge

Alon Talmor, Jonathan Herzig, Nicholas Lourie, and Jonathan Berant. 2019 · 2019

Earlier work this paper cites.

Piqa: Reasoning about physical commonsense in natural language

Yonatan Bisk, Rowan Zellers, Jianfeng Gao, Yejin Choi, et al. 2020 · 2020

Earlier work this paper cites.

Deberta: Decoding-enhanced bert with disentangled attention

Pengcheng He, Xiaodong Liu, Jianfeng Gao, and Weizhu Chen. 2020 · 2020

Earlier work this paper cites.

Comet-atomic 2020: On symbolic and neural commonsense knowledge graphs

Jena D. Hwang, Chandra Bhagavatula, Ronan Le Bras, Jeff Da, Keisuke Sakaguchi, Antoine Bosselut, and Yejin Choi. 2021 · 2020

Earlier work this paper cites.

Bird-qa: a bert-based information retrieval approach to domain specific question answering

Yuhao Chen and Farhana Zulkernine. 2021 · 2021

Earlier work this paper cites.

Riddlesense: Reasoning about riddle questions featuring linguistic creativity and commonsense knowledge

Original

Bill Yuchen Lin, Ziyi Wu, Yichi Yang, Dong-Ho Lee, and Xiang Ren. 2021 · 2021

Earlier work this paper cites.

Exploring strategies for generalizable commonsense reasoning with pre-trained models

Kaixin Ma, Filip Ilievski, Jonathan Francis, Satoru Ozaki, Eric Nyberg, and Alessandro Oltramari. 2021b · 2021

Earlier work this paper cites.

Multitask prompted training enables zero-shot task generalization

Original

Victor Sanh, Albert Webson, Colin Raffel, Stephen H Bach, Lintang Sutawika, Zaid Alyafeai, Antoine Chaffin, Arnaud Stiegler, Teven Le Scao, Arun Raja, et al. 2021 · 2021

Earlier work this paper cites.

Scaling instruction-finetuned language models

Original

Hyung Won Chung, Le Hou, Shayne Longpre, Barret Zoph, Yi Tay, William Fedus, Yunxuan Li, Xuezhi Wang, Mostafa Dehghani, Siddhartha Brahma, et al. 2022 · 2022

Earlier work this paper cites.

Fine-tuning can distort pretrained features and underperform out-of-distribution

Ananya Kumar, Aditi Raghunathan, Robbie Jones, Tengyu Ma, and Percy Liang. 2022 · 2022

Earlier work this paper cites.

Self-consistency improves chain of thought reasoning in language models

Original

Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou. 2022 · 2022

Cited alongside, same era.

A study of zero-shot adaptation with commonsense knowledge

Jiarui Zhang, Filip Ilievski, Kaixin Ma, Jonathan Francis, and Alessandro Oltramari. 2022 · 2022

Cited alongside, same era.

Reconcile: Round-table conference improves reasoning via consensus among diverse llms

Original

Justin Chih-Yao Chen, Swarnadeep Saha, and Mohit Bansal. 2023 · 2023

Cited alongside, same era.

BRAINTEASER: Lateral thinking puzzles for large language models

Yifan Jiang, Filip Ilievski, Kaixin Ma, and Zhivar Sourati. 2023c · 2023

Cited alongside, same era.

Large language models as general pattern machines

Suvir Mirchandani, Fei Xia, Pete Florence, Danny Driess, Montserrat Gonzalez Arenas, Kanishka Rao, Dorsa Sadigh, Andy Zeng, et al. 2023 · 2023

Hw-tsc at semeval-2024 task 9: Exploring prompt engineering strategies for brain teaser puzzles through llms

Yinglu Li, Zhao Yanqing, Min Zhang, Yadong Deng, Aiju Geng, Xiaoqin Liu, Mengxin Ren, Yuang Li, Su Chang, Xiaofeng Zhao, Xiaosong Qiao, Ming Zhu, Yilun Liu, Mengyao Piao, Feiyu Yao, shimin tao, Hao Yang, and Yanfei Jiang. 2024 · 2024

Closest in time.

Davinci at semeval-2024 task 9: Few-shot prompting gpt-3.5 for unconventional reasoning

Suyash Vardhan Mathur, Akshett Jindal, and Manish Shrivastava. 2024 · 2024

Closest in time.

Amazutah_nlp at semeval-2024 task 9: A multichoice question answering system for commonsense defying reasoning

Soumya Mishra and Mina Ghashami. 2024 · 2024

Closest in time.

Ails-ntua at semeval-2024 task 9: Cracking brain teasers: Transformer models for lateral thinking puzzles

Ioannis Panagiotopoulos, George Filandrianos, Maria Lymperaiou, and Giorgos Stamou. 2024 · 2024

Closest in time.

Nimz at semeval-2024 task 9: Evaluating methods in solving brainteasers defying commonsense

Zahra Rahimi, Mohammad Moein Shirzady, Zeinab Taghavi, and Hossein Sameti. 2024 · 2024