Automated Peer Reviewing in Paper SEA: Standardization, Evaluation, and Analysis

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 1901

Earlier work this paper cites.

Bertscore: Evaluating text generation with bert

Original

Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q Weinberger, and Yoav Artzi. 2019 · 1904

Earlier work this paper cites.

Roberta: A robustly optimized bert pretraining approach

Original

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907

Earlier work this paper cites.

Distilbert, a distilled version of bert: smaller, faster, cheaper and lighter

Original

Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019 · 1910

Earlier work this paper cites.

Development of the review quality instrument (rqi) for assessing peer reviews of manuscripts

Susan Van Rooyen, Nick Black, and Fiona Godlee. 1999 · 1999

Earlier work this paper cites.

Bleu: a method for automatic evaluation of machine translation

Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002

Earlier work this paper cites.

Rouge: A package for automatic evaluation of summaries

Chin-Yew Lin. 2004 · 2004

Earlier work this paper cites.

The publishing delay in scholarly peer-reviewed journals

Bo-Christer Björk and David Solomon. 2013 · 2013

Earlier work this paper cites.

Bias in peer review

Carole J Lee, Cassidy R Sugimoto, Guo Zhang, and Blaise Cronin. 2013 · 2013

Earlier work this paper cites.

Peer review in scientific publications: benefits, critiques, & a survival guide

Jacalyn Kelly, Tara Sadeghieh, and Khosrow Adeli. 2014 · 2014

Earlier work this paper cites.

Growth rates of modern science: A bibliometric analysis based on the number of publications and cited references

Lutz Bornmann and Rüdiger Mutz. 2015 · 2015

Earlier work this paper cites.

The changing forms and expectations of peer review

SPJM ( Serge) Horbach and W ( Willem) Halffman. 2018 · 2018

Earlier work this paper cites.

A dataset of peer reviews (peerread): Collection, insights and nlp applications

Original

Dongyeop Kang, Waleed Ammar, Bhavana Dalvi, Madeleine Van Zuylen, Sebastian Kohlmeier, Eduard Hovy, and Roy Schwartz. 2018 · 2018

Earlier work this paper cites.

SPECTER: Document-level representation learning using citation-informed transformers

Arman Cohan, Sergey Feldman, Iz Beltagy, Doug Downey, and Daniel Weld. 2020 · 2020

Cited alongside, same era.

ReviewRobot: Explainable paper review generation based on knowledge synthesis

Qingyun Wang, Qi Zeng, Lifu Huang, Kevin Knight, Heng Ji, and Nazneen Fatema Rajani. 2020 · 2020

Cited alongside, same era.

Train short, test long: Attention with linear biases enables input length extrapolation

Ofir Press, Noah Smith, and Mike Lewis. 2021 · 2021

Cited alongside, same era.

Nlpeer: A unified resource for the computational study of peer review

Original

Nils Dycke, Ilia Kuznetsov, and Iryna Gurevych. 2022 · 2022

Cited alongside, same era.

A length-extrapolatable transformer

Original

Yutao Sun, Li Dong, Barun Patra, Shuming Ma, Shaohan Huang, Alon Benhaim, Vishrav Chaudhary, Xia Song, and Furu Wei. 2022 · 2022

Using transformer language models to validate peer-assigned essay scores in massive open online courses (moocs)

Wesley Morris, Scott Crossley, Langdon Holmes, and Anne Trumbore. 2023 · 2023

Later among the works it cites.

Alpaca: A strong, replicable instruction-following model

Rohan Taori, Ishaan Gulrajani, Tianyi Zhang, Yann Dubois, Xuechen Li, Carlos Guestrin, Percy Liang, and Tatsunori B Hashimoto. 2023 · 2023

Later among the works it cites.

Llama: Open and efficient foundation language models

Original

Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, et al. 2023 · 2023

Later among the works it cites.

Academicgpt: Empowering academic research

Original

Shufa Wei, Xiaolong Xu, Xianbiao Qi, Xi Yin, Jun Xia, Jingyi Ren, Peijun Tang, Yuxiang Zhong, Yihao Chen, Xiaoqin Ren, et al. 2023 · 2023

Later among the works it cites.

Effective long-context scaling of foundation models