LazyReview A Dataset for Uncovering Lazy Thinking in NLP Peer Reviews

Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons

Ralph Allan Bradley and Milton E. Terry. 1952 · 1952

Earlier work this paper cites.

The Matthew effect in science: The reward and communication systems of science are considered

Robert K Merton. 1968 · 1968

Earlier work this paper cites.

Judgment under uncertainty: Heuristics and biases

Amos Tversky, Daniel Kahneman, and Paul Slovic. 1974 · 1974

Earlier work this paper cites.

The Measurement of Observer Agreement for Categorical Data

J Richard Landis and Gary G Koch. 1977 · 1977

Earlier work this paper cites.

Learning from Examples: Instructional Principles from the Worked Examples Research

Robert K. Atkinson, Sharon J. Derry, Alexander Renkl, and Donald Wortham. 2000 · 2000

Earlier work this paper cites.

An overview of scientific and scholarly journal publishing

Mark Ware and Michael Mabe. 2009 · 2009

Earlier work this paper cites.

Scientific literature: Information overload

Esther Landhuis. 2016 · 2016

Earlier work this paper cites.

The Use of Heuristics in Decision Making Under Risk and Uncertainty , pages 153–179

Martina Raue and Sabine G. Scholl. 2018 · 2018

Earlier work this paper cites.

SciBERT: A Pretrained Language Model for Scientific Text

Iz Beltagy, Kyle Lo, and Arman Cohan. 2019 · 2019

Earlier work this paper cites.

Advice on Reviewing for EMNLP

Yang Liu, Trevor Cohn, Bonnie Webber, and Yulan He. 2020 · 2020

Earlier work this paper cites.

What Can We Do to Improve Peer Review in NLP?

Anna Rogers and Isabelle Augenstein. 2020 · 2020

Earlier work this paper cites.

Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies

Mor Geva, Daniel Khashabi, Elad Segal, Tushar Khot, Dan Roth, and Jonathan Berant. 2021 · 2021

Earlier work this paper cites.

How to review for ACL Rolling Review

Anne Rogers and Isabelle Augenstein. 2021 · 2021

Earlier work this paper cites.

Yes-Yes-Yes: Proactive Data Collection for ACL Rolling Review and Beyond

Nils Dycke, Ilia Kuznetsov, and Iryna Gurevych. 2022 · 2022

Earlier work this paper cites.

LoRA: Low-Rank Adaptation of Large Language Models

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2022 · 2022

Earlier work this paper cites.

DISAPERE: A Dataset for Discourse Structure in Peer Review Discussions

Neha Nayak Kennard, Tim O’Gorman, Rajarshi Das, Akshay Sharma, Chhandak Bagchi, Matthew Clinton, Pranay Kumar Yelugam, Hamed Zamani, and Andrew McCallum. 2022 · 2022

Earlier work this paper cites.

«I Do Not Have Time»-Is This the End of Peer Review in Public Health Sciences?

Nino Künzli, Anke Berger, Katarzyna Czabanowska, Raquel Lucas, Andrea Madarasova Geckova, Sarah Mantwill, and Olaf von dem Knesebeck. 2022 · 2022

Earlier work this paper cites.

Compute trends across three eras of machine learning

Jaime Sevilla, Lennart Heim, Anson Ho, Tamay Besiroglu, Marius Hobbhahn, and Pablo Villalobos. 2022 · 2022

Earlier work this paper cites.

Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text

Siyuan Wang, Wanjun Zhong, Duyu Tang, Zhongyu Wei, Zhihao Fan, Daxin Jiang, Ming Zhou, and Nan Duan. 2022b · 2022

Cited alongside, same era.

Can We Automate Scientific Reviewing?

Weizhe Yuan, Pengfei Liu, and Graham Neubig. 2022 · 2022

Cited alongside, same era.

Qwen technical report

Original

Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, Binyuan Hui, Luo Ji, Mei Li, Junyang Lin, Runji Lin, Dayiheng Liu, Gao Liu, Chengqiang Lu, Keming Lu, Jianxin Ma, Rui Men, Xingzhang Ren, Xuancheng Ren, Chuanqi Tan, et al. 2023 · 2023

Cited alongside, same era.

PolitePEER: does peer review hurt? a dataset to gauge politeness intensity in the peer reviews

Prabhat Kumar Bharti, Meith Navlakha, Mayank Agarwal, and Asif Ekbal. 2023 · 2023

Cited alongside, same era.

NLPeer: A unified resource for the computational study of peer review

Nils Dycke, Ilia Kuznetsov, and Iryna Gurevych. 2023 · 2023

Cited alongside, same era.

OpenICL: An Open-Source Framework for In-context Learning

Zhenyu Wu, Yaoxiang Wang, Jiacheng Ye, Zhiyong Wu, Jiangtao Feng, Jingjing Xu, and Yu Qiao. 2023 · 2023

Later among the works it cites.

GPT-4 Technical Report

Original

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. 2024 · 2024

Later among the works it cites.

Please be polite to your peers: a multi-task model for assessing the tone and objectivity of critiques of peer review comments

Prabhat Kumar Bharti, Mayank Agarwal, and Asif Ekbal. 2024 · 2024

Later among the works it cites.

Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference

Wei-Lin Chiang, Lianmin Zheng, Ying Sheng, Anastasios N. Angelopoulos, Tianle Li, Dacheng Li, Banghua Zhu, Hao Zhang, Michael I. Jordan, Joseph E. Gonzalez, and Ion Stoica. 2024 · 2024

Later among the works it cites.

LLMs assist NLP researchers: Critique paper (meta-)reviewing

Jiangshu Du, Yibo Wang, Wenting Zhao, Zhongfen Deng, Shuaiqi Liu, Renze Lou, Henry Peng Zou, Pranav Narayanan Venkit, Nan Zhang, Mukund Srinath, Haoran Ranran Zhang, Vipul Gupta, Yinghui Li, Tao Li, Fei Wang, Qin Liu, Tianlin Liu, Pengzhi Gao, Congying Xia, Chen Xing, Cheng Jiayang, Zhaowei Wang, Ying Su, Raj Sanjay Shah, Ruohao Guo, Jing Gu, Haoran Li, Kangda Wei, Zihao Wang, Lu Cheng, Surangika Ranathunga, Meng Fang, Jie Fu, Fei Liu, Ruihong Huang, Eduardo Blanco, Yixin Cao, Rui Zhang, Philip S. Yu, and Wenpeng Yin. 2024 · 2024