LLMs Assist NLP Researchers: Critique Paper (Meta-)Reviewing

Rouge: A package for automatic evaluation of summaries

Chin-Yew Lin. 2004 · 2004

Earlier work this paper cites.

Automatically predicting peer-review helpfulness

Wenting Xiong and Diane Litman. 2011 · 2011

Earlier work this paper cites.

A dataset of peer reviews (PeerRead): Collection, insights and NLP applications

Dongyeop Kang, Waleed Ammar, Bhavana Dalvi, Madeleine van Zuylen, Sebastian Kohlmeier, Eduard Hovy, and Roy Schwartz. 2018 · 2018

Earlier work this paper cites.

Argument mining for understanding peer reviews

Xinyu Hua, Mitko Nikolov, Nikhil Badugu, and Lu Wang. 2019 · 2019

Earlier work this paper cites.

Sentence-bert: Sentence embeddings using siamese bert-networks

Nils Reimers and Iryna Gurevych. 2019 · 2019

Earlier work this paper cites.

Ape: Argument pair extraction from peer review and rebuttal via multi-task learning

Liying Cheng, Lidong Bing, Qian Yu, Wei Lu, and Luo Si. 2020 · 2020

Earlier work this paper cites.

Hierarchical bi-directional self-attention networks for paper review rating recommendation

Zhongfen Deng, Hao Peng, Congying Xia, Jianxin Li, Lifang He, and S Yu Philip. 2020 · 2020

Earlier work this paper cites.

Multi-task peer-review score prediction

Jiyi Li, Ayaka Sato, Kazuya Shimura, and Fumiyo Fukumoto. 2020 · 2020

Earlier work this paper cites.

ReviewRobot: Explainable paper review generation based on knowledge synthesis

Qingyun Wang, Qi Zeng, Lifu Huang, Kevin Knight, Heng Ji, and Nazneen Fatema Rajani. 2020 · 2020

Earlier work this paper cites.

Bertscore: Evaluating text generation with bert

Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q. Weinberger, and Yoav Artzi. 2020 · 2020

Earlier work this paper cites.

A deep neural architecture based meta-review generation and final decision prediction of a scholarly article

Tribikram Pradhan, Chaitanya Bhatia, Prashant Kumar, and Sukomal Pal. 2021 · 2021

Earlier work this paper cites.

DISAPERE: A dataset for discourse structure in peer review discussions

Neha Nayak Kennard, Tim O’Gorman, Rajarshi Das, Akshay Sharma, Chhandak Bagchi, Matthew Clinton, Pranay Kumar Yelugam, Hamed Zamani, and Andrew McCallum. 2022 · 2022

Earlier work this paper cites.

MReD: A meta-review dataset for structure-controllable text generation

Chenhui Shen, Liying Cheng, Ran Zhou, Lidong Bing, Yang You, and Luo Si. 2022 · 2022

Cited alongside, same era.

Can we automate scientific reviewing?

Weizhe Yuan, Pengfei Liu, and Graham Neubig. 2022 · 2022

Cited alongside, same era.

Artificial intelligence in scientific writing: a friend or a foe?

Signe Altmäe, Alberto Sola-Leyva, and Andres Salumets. 2023 · 2023

Cited alongside, same era.

Qwen technical report

Original

Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, Binyuan Hui, Luo Ji, Mei Li, Junyang Lin, Runji Lin, Dayiheng Liu, Gao Liu, Chengqiang Lu, Keming Lu, Jianxin Ma, Rui Men, Xingzhang Ren, Xuancheng Ren, Chuanqi Tan, Sinan Tan, Jianhong Tu, Peng Wang, Shijie Wang, Wei Wang, Shengguang Wu, Benfeng Xu, Jin Xu, An Yang, Hao Yang, Jian Yang, Shusheng Yang, Yang Yao, Bowen Yu, Hongyi Yuan, Zheng Yuan, Jianwei Zhang, Xingxuan Zhang, Yichang Zhang, Zhenru Zhang, Chang Zhou, Jingren Zhou, Xiaohuan Zhou, and Tianhang Zhu. 2023 · 2023

Cited alongside, same era.

Politepeer: does peer review hurt? a dataset to gauge politeness intensity in the peer reviews

Reviewergpt? an exploratory study on using large language models for paper reviewing

Original

Ryan Liu and Nihar B Shah. 2023 · 2023

Later among the works it cites.

Chatgpt and large language models in academia: opportunities and challenges

Jesse G Meyer, Ryan J Urbanowicz, Patrick CN Martin, Karen O’Connor, Ruowang Li, Pei-Chen Peng, Tiffani J Bright, Nicholas Tatonetti, Kyoung Jae Won, Graciela Gonzalez-Hernandez, et al. 2023 · 2023

Later among the works it cites.

A comprehensive overview of large language models

Original

Humza Naveed, Asad Ullah Khan, Shi Qiu, Muhammad Saqib, Saeed Anwar, Muhammad Usman, Nick Barnes, and Ajmal Mian. 2023 · 2023

Later among the works it cites.

Gpt-4 technical report

Original

OpenAI. 2023 · 2023

Later among the works it cites.

Gpt4 is slightly helpful for peer-review assistance: A pilot study