From Generalist to Specialist: A Survey of Large Language Models for Chemistry

Strategies for pre-training graph neural networks

Original

Weihua Hu, Bowen Liu, Joseph Gomes, Marinka Zitnik, Percy Liang, Vijay Pande, and Jure Leskovec. 2019 · 1905

Earlier work this paper cites.

Usage and limitations of liquid chromatography-tandem mass spectrometry (lc-ms/ms) in clinical routine laboratories

Christoph Seger. 2012 · 1946

Earlier work this paper cites.

The generation of a unique machine description for chemical structures-a technique developed at chemical abstracts service

Harry L Morgan. 1965 · 1965

Earlier work this paper cites.

Smiles, a chemical language and information system. 1. introduction to methodology and encoding rules

David Weininger. 1988 · 1988

Earlier work this paper cites.

Simple statistical gradient-following algorithms for connectionist reinforcement learning

Ronald J Williams. 1992 · 1992

Earlier work this paper cites.

An image is worth 16x16 words: Transformers for image recognition at scale

Original

Alexey Dosovitskiy. 2020 · 2010

Earlier work this paper cites.

Large-pore apertures in a series of metal-organic frameworks

Hexiang Deng, Sergio Grunder, Kyle E Cordova, Cory Valente, Hiroyasu Furukawa, Mohamad Hmadeh, Felipe Gándara, Adam C Whalley, Zheng Liu, Shunsuke Asahina, et al. 2012 · 2012

Earlier work this paper cites.

Nuclear magnetic resonance spectroscopy and its key role in environmental research

Andre J Simpson, Myrna J Simpson, and Ronald Soong. 2012 · 2012

Earlier work this paper cites.

Inchi-the worldwide chemical structure identifier standard

Stephen Heller, Alan McNaught, Stephen Stein, Dmitrii Tchekhovskoi, and Igor Pletnev. 2013 · 2013

Earlier work this paper cites.

Commentary: The materials project: A materials genome approach to accelerating materials innovation

Anubhav Jain, Shyue Ping Ong, Geoffroy Hautier, Wei Chen, William Davidson Richards, Stephen Dacek, Shreyas Cholia, Dan Gunter, David Skinner, Gerbrand Ceder, et al. 2013 · 2013

Earlier work this paper cites.

Auto-encoding variational bayes

Original

Diederik P Kingma. 2013 · 2013

Earlier work this paper cites.

Metal–organic frameworks (mofs)

Susumu Kitagawa et al. 2014 · 2014

Earlier work this paper cites.

Searching molecular structure databases with tandem mass spectra using csi: Fingerid

Kai Dührkop, Huibin Shen, Marvin Meusel, Juho Rousu, and Sebastian Böcker. 2015 · 2015

Earlier work this paper cites.

Convolutional networks on graphs for learning molecular fingerprints

David K Duvenaud, Dougal Maclaurin, Jorge Iparraguirre, Rafael Bombarell, Timothy Hirzel, Alán Aspuru-Guzik, and Ryan P Adams. 2015 · 2015

Earlier work this paper cites.

Neural machine translation of rare words with subword units

Original

Rico Sennrich. 2015 · 2015

Earlier work this paper cites.

Zinc 15–ligand discovery for everyone

Teague Sterling and John J Irwin. 2015 · 2015

Earlier work this paper cites.

Deep reinforcement learning from human preferences

Paul F Christiano, Jan Leike, Tom Brown, Miljan Martic, Shane Legg, and Dario Amodei. 2017 · 2017

Earlier work this paper cites.

Proximal policy optimization algorithms

Original

John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017 · 2017

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

Crowdsourcing multiple choice science questions

Original

Johannes Welbl, Nelson F Liu, and Matt Gardner. 2017 · 2017

Earlier work this paper cites.

Bert: Pre-training of deep bidirectional transformers for language understanding

Original

Jacob Devlin. 2018 · 2018

Earlier work this paper cites.

Schnet–a deep learning architecture for molecules and materials

Kristof T Schütt, Huziel E Sauceda, P-J Kindermans, Alexandre Tkatchenko, and K-R Müller. 2018 · 2018

Earlier work this paper cites.

Planning chemical syntheses with deep neural networks and symbolic ai

Marwin HS Segler, Mike Preuss, and Mark P Waller. 2018 · 2018

Earlier work this paper cites.

Moleculenet: a benchmark for molecular machine learning

Zhenqin Wu, Bharath Ramsundar, Evan N Feinberg, Joseph Gomes, Caleb Geniesse, Aneesh S Pappu, Karl Leswing, and Vijay Pande. 2018 · 2018

Earlier work this paper cites.

How powerful are graph neural networks?

Original

Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. 2018 · 2018

Earlier work this paper cites.

Pubchem 2019 update: improved access to chemical data

Sunghwan Kim, Jie Chen, Tiejun Cheng, Asta Gindulyte, Jia He, Siqian He, Qingliang Li, Benjamin A Shoemaker, Paul A Thiessen, Bo Yu, et al. 2019 · 2019

Earlier work this paper cites.

N-gram graph: Simple unsupervised representation for graphs, with applications to molecules

Shengchao Liu, Mehmet F Demirel, and Yingyu Liang. 2019 · 2019

Earlier work this paper cites.

Language models are unsupervised multitask learners

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019 · 2019

Earlier work this paper cites.

Self-referencing embedded strings (selfies): A 100% robust molecular string representation

Mario Krenn, Florian Häse, AkshatKumar Nigam, Pascal Friederich, and Alan Aspuru-Guzik. 2020 · 2020

Earlier work this paper cites.

Retrieval-augmented generation for knowledge-intensive nlp tasks

Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, et al. 2020 · 2020

Earlier work this paper cites.

Transfer learning enables the molecular transformer to predict regio-and stereoselective reactions on carbohydrates

Giorgio Pesciullesi, Philippe Schwaller, Teodoro Laino, and Jean-Louis Reymond. 2020 · 2020

Earlier work this paper cites.

Exploring the limits of transfer learning with a unified text-to-text transformer

Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. 2020 · 2020

Earlier work this paper cites.

Learning to summarize with human feedback

Nisan Stiennon, Long Ouyang, Jeffrey Wu, Daniel Ziegler, Ryan Lowe, Chelsea Voss, Alec Radford, Dario Amodei, and Paul F Christiano. 2020 · 2020

Earlier work this paper cites.

Geometric deep learning on molecular representations

Kenneth Atz, Francesca Grisoni, and Gisbert Schneider. 2021 · 2021

Earlier work this paper cites.

Img2mol–accurate smiles recognition from molecular graphical depictions

Djork-Arné Clevert, Tuan Le, Robin Winter, and Floriane Montanari. 2021 · 2021

Earlier work this paper cites.

Text2mol: Cross-modal molecule retrieval with natural language queries

Carl Edwards, ChengXiang Zhai, and Heng Ji. 2021 · 2021

Earlier work this paper cites.

Swin transformer: Hierarchical vision transformer using shifted windows

Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. 2021 · 2021

Earlier work this paper cites.

E (n) equivariant graph neural networks

Vıctor Garcia Satorras, Emiel Hoogeboom, and Max Welling. 2021 · 2021

Earlier work this paper cites.

Cfm-id 4.0: more accurate esi-ms/ms spectral prediction and compound identification

Fei Wang, Jaanus Liigand, Siyang Tian, David Arndt, Russell Greiner, and David S Wishart. 2021 · 2021

Earlier work this paper cites.

Chemberta-2: Towards chemical foundation models

Original

Walid Ahmad, Elana Simon, Seyone Chithrananda, Gabriel Grand, and Bharath Ramsundar. 2022 · 2022

Earlier work this paper cites.

Flamingo: a visual language model for few-shot learning

Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Hasson, Karel Lenc, Arthur Mensch, Katherine Millican, Malcolm Reynolds, et al. 2022 · 2022

Earlier work this paper cites.

Constitutional ai: Harmlessness from ai feedback

Original

Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen, Anna Goldie, Azalia Mirhoseini, Cameron McKinnon, et al. 2022 · 2022

Cited alongside, same era.

Translation between molecules and natural language

Original

Carl Edwards, Tuan Lai, Kevin Ros, Garrett Honke, Kyunghyun Cho, and Heng Ji. 2022 · 2022

Cited alongside, same era.

Brio: Bringing order to abstractive summarization

Original

Yixin Liu, Pengfei Liu, Dragomir Radev, and Graham Neubig. 2022 · 2022

Cited alongside, same era.

Learn to explain: Multimodal reasoning via thought chains for science question answering

Pan Lu, Swaroop Mishra, Tanglin Xia, Liang Qiu, Kai-Wei Chang, Song-Chun Zhu, Oyvind Tafjord, Peter Clark, and Ashwin Kalyan. 2022 · 2022

Cited alongside, same era.

Training language models to follow instructions with human feedback

Uni-mol: A universal 3d molecular representation learning framework

Gengmo Zhou, Zhifeng Gao, Qiankun Ding, Hang Zheng, Hongteng Xu, Zhewei Wei, Linfeng Zhang, and Guolin Ke. 2023 · 2023

Later among the works it cites.

Unraveling molecular structure: A multimodal spectroscopic dataset for chemistry

Original

Marvin Alberts, Oliver Schilter, Federico Zipoli, Nina Hartrampf, and Teodoro Laino. 2024 · 2024

Closest in time.

Introducing claude models, https://www.anthropic.com

Anthropic. 2024 · 2024

Closest in time.

Massspecgym: A benchmark for the discovery and identification of molecules

Original

Roman Bushuiev, Anton Bushuiev, Niek F de Jonge, Adamo Young, Fleming Kretschmer, Raman Samusevich, Janne Heirman, Fei Wang, Luke Zhang, Kai Dührkop, et al. 2024 · 2024

Closest in time.

Sciassess: Benchmarking llm proficiency in scientific literature analysis

Original