Fetching the paper…
Reading the bibliography…
Peer review at AI conferences is stressed by rapidly rising submission volumes, leading to deteriorating review quality and increased author dissatisfaction.
Is peer review broken? submissions are up, reviewers are overtaxed, and authors are lodging complaint after complaint about the process at top-tier journals. what’s wrong with peer review?, 2006
Alison McCook · 2006
Earlier work this paper cites.
Editorial: Reviewing peer review
Bruce Alberts, Brooks Hanson, and Katrina L. Kelner · 2008
Earlier work this paper cites.
A framework for optimizing paper matching
Laurent Charlin, Richard S Zemel, and Craig Boutilier · 2011
Earlier work this paper cites.
Peer review in scientific publications: benefits, critiques, & a survival guide
Jacalyn Kelly, Tara Sadeghieh, and Khosrow Adeli · 2014
Earlier work this paper cites.
Open access is tiring out peer reviewers
Martijn Arns · 2014
Earlier work this paper cites.
Last minute reviewing advice, 2017
ACL PC Chairs · 2017
Earlier work this paper cites.
Computational support for academic peer review: a perspective from artificial intelligence
Simon Price and Peter A. Flach · 2017
Earlier work this paper cites.
Global state of peer review 2018, 2018
Publons · 2018
Earlier work this paper cites.
Unprofessional peer reviews disproportionately harm underrepresented groups in stem
Nyssa J Silbiger and Amber D Stubler · 2019
Earlier work this paper cites.
What can we do to improve peer review in NLP?
Anna Rogers and Isabelle Augenstein · 2020
Earlier work this paper cites.
Inconsistency in conference peer review: Revisiting the 2014 neurips experiment, 2021
Corinna Cortes and Neil D. Lawrence · 2021
Earlier work this paper cites.
Lxcv @ cvpr 2021 reviewer mentoring program: And how to write good reviews, 2021
Matias Valdenegro · 2021
Earlier work this paper cites.
Arr reviewer guidelines, 2021
Isabelle Augenstein Anna Rogers · 2021
Earlier work this paper cites.
Ai-assisted peer review
Alessandro Checco, Lorenzo Bracciale, Pierpaolo Loreti, Stephen Pinfield, and Giuseppe Bianchi · 2021
Earlier work this paper cites.
How to be a good reviewer? reviewer tutorial for icml 2022, 2022
ICML 2022 Program Chairs · 2022
Earlier work this paper cites.
Challenges, experiments, and computational solutions in peer review
Nihar B. Shah · 2022
Cited alongside, same era.
Program chairs’ report on peer review at acl 2023
Anna Rogers, Marzena Karpinska, Jordan Boyd-Graber, and Naoaki Okazaki · 2023
Cited alongside, same era.
Self-refine: Iterative refinement with self-feedback, 2023
Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa Prasad Majumder, Katherine Hermann, Sean Welleck, Amir Yazdanbakhsh, and Peter Clark · 2023
Cited alongside, same era.
Fighting reviewer fatigue or amplifying bias? considerations and recommendations for use of chatgpt and other large language models in scholarly peer review
Mohammad Hosseini and Serge P J M Horbach · 2023
Cited alongside, same era.
Siren’s song in the ai ocean: a survey on hallucination in large language models
Yue Zhang, Yafu Li, Leyang Cui, Deng Cai, Lemao Liu, Tingchen Fu, Xinting Huang, Enbo Zhao, Yu Zhang, Yulong Chen, et al · 2023
Can large language models provide useful feedback on research papers? a large-scale empirical analysis
Weixin Liang, Yuhui Zhang, Hancheng Cao, Binglu Wang, Daisy Yi Ding, Xinyu Yang, Kailas Vodrahalli, Siyu He, Daniel Scott Smith, Yian Yin, et al · 2024
Later among the works it cites.
Textgrad: Automatic ”differentiation” via text, 2024
Mert Yuksekgonul, Federico Bianchi, Joseph Boen, Sheng Liu, Zhi Huang, Carlos Guestrin, and James Zou · 2024
Later among the works it cites.
Monitoring ai-modified content at scale: A case study on the impact of chatgpt on ai conference peer reviews, 2024
Weixin Liang, Zachary Izzo, Yaohui Zhang, Haley Lepp, Hancheng Cao, Xuandong Zhao, Lingjiao Chen, Haotian Ye, Sheng Liu, Zhi Huang, Daniel A. McFarland, and James Y. Zou · 2024
Later among the works it cites.
The pypdf library, 2024
Mathieu Fenniak, Matthew Stamy, pubpub zz, Martin Thoma, Matthew Peveler, exiledkingcc, and pypdf Contributors · 2024
Later among the works it cites.
Usefulness of llms as an author checklist assistant for scientific papers: Neurips’24 experiment, 2024
Alexander Goldberg, Ihsan Ullah, Thanh Gia Hieu Khuong, Benedictus Kent Rachmat, Zhen Xu, Isabelle Guyon, and Nihar B. Shah · 2024
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Instruction-following evaluation for large language models
Jeffrey Zhou, Tianjian Lu, Swaroop Mishra, Siddhartha Brahma, Sujoy Basu, Yi Luan, Denny Zhou, and Le Hou · 2023
Cited alongside, same era.
Icml 2023 reviewer tutorial, 2023
ICML 2023 program committee · 2023
Cited alongside, same era.
Testing language models (and prompts) like we test software, 2023
Marco Tulio Ribeiro and Scott Lundberg · 2023
Cited alongside, same era.
Reviewergpt? an exploratory study on using large language models for paper reviewing, 2023
Ryan Liu and Nihar B. Shah · 2023
Cited alongside, same era.
Chatgpt and the future of journal reviews: A feasibility study
Som Biswas, Dushyant Dobaria, and Harris L. Cohen · 2023
Cited alongside, same era.
Best practices for using ai tools as an author, peer reviewer, or editor
Tiffany I Leung, Taiane de Azevedo Cardoso, Amaryllis Mavragani, and Gunther Eysenbach · 2023
Cited alongside, same era.
Reviewriter: AI-generated instructions for peer review writing
Xiaotian Su, Thiemo Wambsganss, Roman Rietsche, Seyed Parsa Neshaei, and Tanja Käser · 2023
Cited alongside, same era.
Later among the works it cites.
Clio: Privacy-preserving insights into real-world ai use, 2024
Alex Tamkin, Miles McCain, Kunal Handa, Esin Durmus, Liane Lovitt, Ankur Rathi, Saffron Huang, Alfred Mountfield, Jerry Hong, Stuart Ritchie, Michael Stern, Brian Clarke, Landon Goldberg, Theodore R. Sumers, Jared Mueller, William McEachen, Wes Mitchell, Shan Carter, Jack Clark, Jared Kaplan, and Deep Ganguli · 2024
Later among the works it cites.
Mapping the increasing use of llms in scientific papers, 2024
Weixin Liang, Yaohui Zhang, Zhengxuan Wu, Haley Lepp, Wenlong Ji, Xuandong Zhao, Hancheng Cao, Sheng Liu, Siyu He, Zhi Huang, Diyi Yang, Christopher Potts, Christopher D Manning, and James Y. Zou · 2024
Later among the works it cites.
Peer review in the age of generative ai
Atreyi Kankanhalli · 2024
Later among the works it cites.
What can natural language processing do for peer review?, 2024
Ilia Kuznetsov, Osama Mohammed Afzal, Koen Dercksen, Nils Dycke, Alexander Goldberg, Tom Hope, Dirk Hovy, Jonathan K. Kummerfeld, Anne Lauscher, Kevin Leyton-Brown, Sheng Lu, Mausam, Margot Mieskes, Aurélie Névéol, Danish Pruthi, Lizhen Qu, Roy Schwartz, Noah A. Smith, Thamar Solorio, Jingyan Wang, Xiaodan Zhu, Anna Rogers, Nihar B. Shah, and Iryna Gurevych · 2024
Later among the works it cites.
Artificial intelligence to support publishing and peer review: A summary and review
Kayvan Kousha and Mike Thelwall · 2024
Later among the works it cites.
Marg: Multi-agent review generation for scientific papers, 2024
Mike D’Arcy, Tom Hope, Larry Birnbaum, and Doug Downey · 2024
Later among the works it cites.
Peer reviews of peer reviews: A randomized controlled trial and other experiments, 2024
Alexander Goldberg, Ivan Stelmakh, Kyunghyun Cho, Alice Oh, Alekh Agarwal, Danielle Belgrave, and Nihar B. Shah · 2024
Later among the works it cites.
Lmunit: Fine-grained evaluation with natural language unit tests, 2024
Jon Saad-Falcon, Rajan Vivek, William Berrios, Nandita Shankar Naik, Matija Franklin, Bertie Vidgen, Amanpreet Singh, Douwe Kiela, and Shikib Mehri · 2024
Later among the works it cites.
Benchmark on peer review toxic detection: A challenging task with a new dataset, 2025
Man Luo, Bradley Peterson, Rafael Gan, Hari Ramalingame, Navya Gangrade, Ariadne Dimarogona, Imon Banerjee, and Phillip Howard · 2025
Closest in time.
Learning to generate unit tests for automated debugging, 2025
Archiki Prasad, Elias Stengel-Eskin, Justin Chih-Yao Chen, Zaid Khan, and Mohit Bansal · 2025
Closest in time.