ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery

Ohio supercomputer center, 1987

Ohio Supercomputer Center · 1987

Earlier work this paper cites.

Cellprofiler: image analysis software for identifying and quantifying cell phenotypes

Anne E. Carpenter, Thouis R. Jones, Michael R. Lamprecht, Colin Clarke, In Han Kang, Ola Friman, David A. Guertin, Joo Han Chang, Robert A. Lindquist, Jason Moffat, Polina Golland, and David M. Sabatini · 2006

Earlier work this paper cites.

Beyond the data deluge

Gordon Bell, Tony Hey, and Alex Szalay · 2009

Earlier work this paper cites.

The Fourth Paradigm: Data-Intensive Scientific Discovery

Tony Hey, Stewart Tansley, Kristin Tolle, and Jim Gray · 2009

Earlier work this paper cites.

Artificial Intelligence: A Modern Approach

Stuart Russell and Peter Norvig · 2010

Earlier work this paper cites.

Human selection of elk behavioural traits in a landscape of fear

Simone Ciuti, Tyler B. Muhlym, Dale G. Paton, Allan D. McDevitt, Marco Musiani, and Mark S. Boyce · 2012

Earlier work this paper cites.

Python materials genomics (pymatgen): A robust, open-source python library for materials analysis

Shyue Ping Ong, William Davidson Richards, Anubhav Jain, Geoffroy Hautier, Michael Kocher, Shreyas Cholia, Dan Gunter, Vincent L. Chevrier, Kristin A. Persson, and Gerbrand Ceder · 2012

Earlier work this paper cites.

Urban climate effects on extreme temperatures in madison, wisconsin, usa

Jason Schatz and Christopher J Kucharik · 2015

Earlier work this paper cites.

eofs: A library for eof analysis of meteorological, oceanographic, and climate data

Andrew Dawson · 2016

Earlier work this paper cites.

Data science: A comprehensive overview

Longbing Cao · 2017

Earlier work this paper cites.

Is multitask deep learning practical for pharma?

Bharath Ramsundar, Bowen Liu, Zhenqin Wu, Andreas Verras, Matthew Tudor, Robert P. Sheridan, and Vijay Pande · 2017

Earlier work this paper cites.

Automated Inference of Chemical Discriminants of Biological Activity , pp. 307–338

Sebastian Raschka, Anne M. Scott, Mar Huertas, Weiming Li, and Leslie A. Kuhn · 2018

Earlier work this paper cites.

Matminer: An open source toolkit for materials data mining

Logan Ward, Alexander Dunn, Alireza Faghaninia, Nils E.R. Zimmermann, Saurabh Bajaj, Qi Wang, Joseph Montoya, Jiming Chen, Kyle Bystrom, Maxwell Dylla, Kyle Chard, Mark Asta, Kristin A. Persson, G. Jeffrey Snyder, Ian Foster, and Anubhav Jain · 2018

Earlier work this paper cites.

Scanpy: large-scale single-cell gene expression data analysis

F. Alexander Wolf, Philipp Angerer, and Fabian J. Theis · 2018

Earlier work this paper cites.

Moleculenet: a benchmark for molecular machine learning

Zhenqin Wu, Bharath Ramsundar, Evan N. Feinberg, Joseph Gomes, Caleb Geniesse, Aneesh S. Pappu, Karl Leswing, and Vijay Pande · 2018

Earlier work this paper cites.

The open global glacier model (oggm) v1.1

F. Maussion, A. Butenko, N. Champollion, M. Dusch, J. Eis, K. Fourteau, P. Gregor, A. H. Jarosch, J. Landmann, F. Oesterle, B. Recinos, T. Rothenpieler, A. Vlug, C. T. Wild, and B. Marzeion · 2019

Earlier work this paper cites.

Deep Learning for the Life Sciences

Bharath Ramsundar, Peter Eastman, Patrick Walters, Vijay Pande, Karl Leswing, and Zhenqin Wu · 2019

Earlier work this paper cites.

Modeling human syllogistic reasoning:the role of “no valid conclusion”

Nicolas Riesterer, Daniel Brand, Hannah Dames, and Marco Ragni · 2019

Earlier work this paper cites.

Analyzing the differences in human reasoning viajoint nonnegative matrix factorization

Daniel Brand, Nicolas Riesterer, Hannah Dames, and Marco Ragni · 2020

Earlier work this paper cites.

Deeppurpose: A deep learning library for drug-target interaction prediction

Kexin Huang, Tianfan Fu, Lucas M Glass, Marinka Zitnik, Cao Xiao, and Jimeng Sun · 2020

Earlier work this paper cites.

The materials simulation toolkit for machine learning (mast-ml): An automated open source toolkit to accelerate data-driven materials research

Ryan Jacobs, Tam Mayeshiba, Ben Afflerbach, Luke Miles, Max Williams, Matthew Turner, Raphael Finkel, and Dane Morgan · 2020

Earlier work this paper cites.

Scirpy: a Scanpy extension for analyzing single-cell T-cell receptor-sequencing data

Gregor Sturm, Tamas Szabo, Georgios Fotakis, Marlene Haider, Dietmar Rieder, Zlatko Trajanoski, and Francesca Finotello · 2020

Earlier work this paper cites.

ProLIF: a library to encode molecular interactions as fingerprints

Cédric Bouysset and Sébastien Fiorucci · 2021

Earlier work this paper cites.

Evaluating large language models trained on code, 2021

Original

Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, Alex Ray, Raul Puri, Gretchen Krueger, Michael Petrov, Heidy Khlaaf, Girish Sastry, Pamela Mishkin, Brooke Chan, Scott Gray, Nick Ryder, Mikhail Pavlov, Alethea Power, Lukasz Kaiser, Mohammad Bavarian, Clemens Winter, Philippe Tillet, Felipe Petroski Such, Dave Cummings, Matthias Plappert, Fotios Chantzis, Elizabeth Barnes, Ariel Herbert-Voss, William Hebgen Guss, Alex Nichol, Alex Paino, Nikolas Tezak, Jie Tang, Igor Babuschkin, Suchir Balaji, Shantanu Jain, William Saunders, Christopher Hesse, Andrew N. Carr, Jan Leike, Josh Achiam, Vedant Misra, Evan Morikawa, Alec Radford, Matthew Knight, Miles Brundage, Mira Murati, Katie Mayer, Peter Welinder, Bob McGrew, Dario Amodei, Sam McCandlish, Ilya Sutskever, and Wojciech Zaremba · 2021

Earlier work this paper cites.

Accelerating high-throughput virtual screening through molecular pool-based active learning

David E. Graff, Eugene I. Shakhnovich, and Connor W. Coley · 2021

Earlier work this paper cites.

Highly accurate protein structure prediction with alphafold

John Jumper, Richard Evans, Alexander Pritzel, Tim Green, Michael Figurnov, Olaf Ronneberger, Kathryn Tunyasuvunakool, Russ Bates, Augustin Žídek, Anna Potapenko, Alex Bridgland, Clemens Meyer, Simon A. A. Kohl, Andrew J. Ballard, Andrew Cowie, Bernardino Romera-Paredes, Stanislav Nikolov, Rishub Jain, Jonas Adler, Trevor Back, Stig Petersen, David Reiman, Ellen Clancy, Michal Zielinski, Martin Steinegger, Michalina Pacholska, Tamas Berghammer, Sebastian Bodenstein, David Silver, Oriol Vinyals, Andrew W. Senior, Koray Kavukcuoglu, Pushmeet Kohli, and Demis Hassabis · 2021

Earlier work this paper cites.

Prediction and mechanistic analysis of drug-induced liver injury (dili) based on chemical structure

Anika Liu, Moritz Walter, Peter Wright, Aleksandra Bartosik, Daniela Dolciami, Abdurrahman Elbasir, Hongbin Yang, and Andreas Bender · 2021

Earlier work this paper cites.

NeuroKit2: A Python toolbox for neurophysiological signal processing

Dominique Makowski, Tam Pham, Zen J. Lau, Jan C. Brammer, François Lespinasse, Hung Pham, Christopher Schölzel, and S. H. Annabel Chen · 2021

Cited alongside, same era.

Benchmarks for interpretation of qsar models

Mariia Matveieva and Pavel Polishchuk · 2021

Cited alongside, same era.

Biopsykit: A python package for the analysis of biopsychological data

Robert Richer, Arne Küderle, Martin Ullrich, Nicolas Rohleder, and Bjoern M. Eskofier · 2021

Cited alongside, same era.

Investigating the preferences of local residents toward a proposed bus network redesign in chattanooga, tennessee

Abubakr Ziedan, Cassidy Crossland, Candace Brakewood, Philip Pugliese, and Harrison Ooi · 2021

Cited alongside, same era.

Muon: multimodal omics analysis framework

Danila Bredikhin, Ilia Kats, and Oliver Stegle · 2022

Cited alongside, same era.

A python library for probabilistic analysis of single-cell omics data

Blade: Benchmarking language model agents for data-driven science, 2024

Original

Ken Gu, Ruoxi Shang, Ruien Jiang, Keying Kuang, Richard-John Lin, Donghe Lyu, Yue Mao, Youran Pan, Teng Wu, Jiaqian Yu, Yikun Zhang, Tianmai M. Zhang, Lanyi Zhu, Mike A. Merrill, Jeffrey Heer, and Tim Althoff · 2024

Closest in time.

WebVoyager: Building an end-to-end web agent with large multimodal models

Hongliang He, Wenlin Yao, Kaixin Ma, Wenhao Yu, Yong Dai, Hongming Zhang, Zhenzhong Lan, and Dong Yu · 2024

Closest in time.

Self-[in]correct: Llms struggle with discriminating self-generated responses, 2024

Original

Dongwei Jiang, Jingyu Zhang, Orion Weller, Nathaniel Weir, Benjamin Van Durme, and Daniel Khashabi · 2024

Closest in time.

SWE-bench: Can language models resolve real-world github issues?

Carlos E Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik R Narasimhan · 2024

Closest in time.

Ai agents that matter, 2024