Fetching the paper…
Reading the bibliography…
Many important problems involving molecular property prediction from 3D structures have limited data, posing a generalization challenge for neural networks.
The truly deep graph convolutional networks for node classification
Yu Rong, Wenbing Huang, Tingyang Xu, and Junzhou Huang · 1907
Earlier work this paper cites.
Deli Chen, Yankai Lin, Wei Li, Peng Li, Jie Zhou, and Xu Sun · 1909
Earlier work this paper cites.
Creating artificial neural networks that generalize
J. Sietsma and Robert J. F. Dow · 1991
Earlier work this paper cites.
Density-Functional Theory of Atoms and Molecules
Robert G. Parr and Yang Weitao · 1994
Earlier work this paper cites.
Training with noise is equivalent to tikhonov regularization
Charles M. Bishop · 1995
Earlier work this paper cites.
Directional message passing for molecular graphs
Johannes Klicpera, Janek Groß, and Stephan Günnemann · 2003
Earlier work this paper cites.
A note on over-smoothing for graph neural networks
Chen Cai and Yusu Wang · 2006
Earlier work this paper cites.
GPT-GNN: generative pre-training of graph neural networks
Ziniu Hu, Yuxiao Dong, Kuansan Wang, Kai-Wei Chang, and Yizhou Sun · 2006
Earlier work this paper cites.
Effective training strategies for deep graph neural networks
Kuangqi Zhou, Yanfei Dong, Wee Sun Lee, Bryan Hooi, Huan Xu, and Jiashi Feng · 2006
Earlier work this paper cites.
Coupled-cluster theory in quantum chemistry
Rodney J. Bartlett and Monika Musiał · 2007
Earlier work this paper cites.
Self-supervised graph transformer on large-scale molecular data, 2020
Yu Rong, Yatao Bian, Tingyang Xu, Weiyang Xie, Ying Wei, Wenbing Huang, and Junzhou Huang · 2007
Earlier work this paper cites.
The graph neural network model
Franco Scarselli, Marco Gori, Ah Chung Tsoi, Markus Hagenbuchner, and Gabriele Monfardini · 2008
Earlier work this paper cites.
Extracting and composing robust features with denoising autoencoders
Pascal Vincent, H. Larochelle, Yoshua Bengio, and Pierre-Antoine Manzagol · 2008
Earlier work this paper cites.
An image is worth 16x16 words: Transformers for image recognition at scale, 2020
Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby · 2010
Earlier work this paper cites.
Stacked denoising autoencoders: Learning useful representations in a deep network with a local denoising criterion
Pascal Vincent, H. Larochelle, Isabelle Lajoie, Yoshua Bengio, and Pierre-Antoine Manzagol · 2010
Earlier work this paper cites.
Fast and uncertainty-aware directional message passing for non-equilibrium molecules
Johannes Klicpera, Shankari Giri, Johannes T. Margraf, and Stephan Günnemann · 2011
Earlier work this paper cites.
A connection between score matching and denoising autoencoders
Pascal Vincent · 2011
Earlier work this paper cites.
Quantum chemistry structures and properties of 134 kilo molecules
R. Ramakrishnan, Pavlo O. Dral, M. Rupp, and O. A. von Lilienfeld · 2014
Earlier work this paper cites.
Very deep convolutional networks for large-scale image recognition, 2014
Karen Simonyan and Andrew Zisserman · 2014
Earlier work this paper cites.
Semi-supervised sequence learning
Andrew M Dai and Quoc V Le · 2015
Earlier work this paper cites.
Interaction networks for learning about objects, relations and physics
P. Battaglia, Razvan Pascanu, Matthew Lai, Danilo Jimenez Rezende, and K. Kavukcuoglu · 2016
Earlier work this paper cites.
Variational graph auto-encoders
Thomas Kipf and Max Welling · 2016
Earlier work this paper cites.
The shattered gradients problem: If resnets are the answer, then what is the question?
David Balduzzi, Marcus Frean, Lennox Leary, JP Lewis, Kurt Wan-Duo Ma, and Brian McWilliams · 2017
Earlier work this paper cites.
Geometric deep learning: going beyond euclidean data
Michael M Bronstein, Joan Bruna, Yann LeCun, Arthur Szlam, and Pierre Vandergheynst · 2017
Earlier work this paper cites.
Pubchemqc project: A large-scale first-principles electronic structure database for data-driven chemistry
Maho Nakata and Tomomi Shimazaki · 2017
Earlier work this paper cites.
Schnet: A continuous-filter convolutional neural network for modeling quantum interactions
Kristof Schütt, Pieter-Jan Kindermans, Huziel Enoc Sauceda Felix, Stefan Chmiela, A. Tkatchenko, and K. Müller · 2017
Earlier work this paper cites.
Relational inductive biases, deep learning, and graph networks
P. Battaglia, Jessica B. Hamrick, V. Bapst, A. Sanchez-Gonzalez, V. Zambaldi, Mateusz Malinowski, Andrea Tacchetti, David Raposo, A. Santoro, R. Faulkner, Çaglar Gülçehre, H. Song, A. J. Ballard, J. Gilmer, George E. Dahl, Ashish Vaswani, Kelsey R. Allen, Charlie Nash, Victoria Langston, Chris Dyer, N. Heess, Daan Wierstra, P. Kohli, M. Botvinick, Oriol Vinyals, Y. Li, and Razvan Pascanu · 2018
Cited alongside, same era.
JAX: composable transformations of Python+NumPy programs, 2018
James Bradbury, Roy Frostig, Peter Hawkins, Matthew James Johnson, Chris Leary, Dougal Maclaurin, George Necula, Adam Paszke, Jake VanderPlas, Skye Wanderman-Milne, and Qiao Zhang · 2018
Cited alongside, same era.
BERT: pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2018
Cited alongside, same era.
Covariant compositional networks for learning graphs
Risi Kondor, Hy Truong Son, Horace Pan, Brandon M. Anderson, and Shubhendu Trivedi · 2018
Cited alongside, same era.
Graph contrastive learning with augmentations
Yuning You, Tianlong Chen, Yongduo Sui, Ting Chen, Zhangyang Wang, and Yang Shen · 2020
Later among the works it cites.
Pairnorm: Tackling oversmoothing in gnns
L. Zhao and Leman Akoglu · 2020
Later among the works it cites.
Se(3)-equivariant graph neural networks for data-efficient and accurate interatomic potentials
Simon Batzner, T. Smidt, L. Sun, J. Mailoa, M. Kornbluth, N. Molinari, and B. Kozinsky · 2021
Later among the works it cites.
Geometric and physical quantities improve e (3) equivariant message passing
Johannes Brandstetter, Rob Hesselink, Elise van der Pol, Erik Bekkers, and Max Welling · 2021
Later among the works it cites.
Open catalyst 2020 (oc20) dataset and community challenges
Lowik Chanussot*, Abhishek Das*, Siddharth Goyal*, Thibaut Lavril*, Muhammed Shuaibi*, Morgane Riviere, Kevin Tran, Javier Heras-Domingo, Caleb Ho, Weihua Hu, Aini Palizhati, Anuroop Sriram, Brandon Wood, Junwoong Yoon, Devi Parikh, C. Lawrence Zitnick, and Zachary Ulissi · 2021
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Graph networks as learnable physics engines for inference and control
Alvaro Sanchez-Gonzalez, N. Heess, Jost Tobias Springenberg, J. Merel, Martin A. Riedmiller, R. Hadsell, and P. Battaglia · 2018
Cited alongside, same era.
Tensor field networks: Rotation- and translation-equivariant neural networks for 3d point clouds
Nathaniel Thomas, Tess Smidt, Steven M. Kearnes, Lusann Yang, Li Li, Kai Kohlhoff, and Patrick Riley · 2018
Cited alongside, same era.
3d steerable cnns: Learning rotationally equivariant features in volumetric data
Maurice Weiler, Mario Geiger, Max Welling, Wouter Boomsma, and Taco Cohen · 2018
Cited alongside, same era.
Dynamical isometry and a mean field theory of cnns: How to train 10,000-layer vanilla convolutional neural networks
Lechao Xiao, Yasaman Bahri, Jascha Sohl-Dickstein, Samuel Schoenholz, and Jeffrey Pennington · 2018
Cited alongside, same era.
Cormorant: Covariant molecular neural networks
Brandon M. Anderson, T. Hy, and R. Kondor · 2019
Cited alongside, same era.
N-gram graph: Simple unsupervised representation for graphs, with applications to molecules
Shengchao Liu, Mehmet F. Demirel, and Yingyu Liang · 2019
Cited alongside, same era.
Generative Modeling by Estimating Gradients of the Data Distribution
Yang Song and Stefano Ermon · 2019
Cited alongside, same era.
Infograph: Unsupervised and semi-supervised graph-level representation learning via mutual information maximization
Fan-Yun Sun, Jordan Hoffman, Vikas Verma, and Jian Tang · 2019
Cited alongside, same era.
Later among the works it cites.
Graph convolutional neural networks with node transition probability-based message passing and dropnode regularization
Tien Huu Do, Duc Minh Nguyen, Giannis Bekoulis, Adrian Munteanu, and N. Deligiannis · 2021
Later among the works it cites.
Quantum chemical benchmark databases of gold-standard dimer interaction energies
Alexander G. Donchev, Andrew G. Taube, Elizabeth Decolvenaere, Cory Hargus, Robert T. McGibbon, Ka-Hei Law, Brent A. Gregersen, Je-Luen Li, Kim Palmo, Karthik Siva, Michael Bergdorf, John L. Klepeis, and David E. Shaw · 2021
Later among the works it cites.
Lietransformer: Equivariant self-attention for lie groups
Michael J Hutchinson, Charline Le Lan, Sheheryar Zaidi, Emilien Dupont, Yee Whye Teh, and Hyunjik Kim · 2021
Later among the works it cites.
Highly accurate protein structure prediction with AlphaFold
John Jumper, Richard Evans, Alexander Pritzel, Tim Green, Michael Figurnov, Olaf Ronneberger, Kathryn Tunyasuvunakool, Russ Bates, Augustin Žídek, Anna Potapenko, Alex Bridgland, Clemens Meyer, Simon A A Kohl, Andrew J Ballard, Andrew Cowie, Bernardino Romera-Paredes, Stanislav Nikolov, Rishub Jain, Jonas Adler, Trevor Back, Stig Petersen, David Reiman, Ellen Clancy, Michal Zielinski, Martin Steinegger, Michalina Pacholska, Tamas Berghammer, Sebastian Bodenstein, David Silver, Oriol Vinyals, Andrew W Senior, Koray Kavukcuoglu, Pushmeet Kohli, and Demis Hassabis · 2021
Later among the works it cites.
James Martens, Andy Ballard, Guillaume Desjardins, Grzegorz Swirszcz, Valentin Dalibard, Jascha Sohl-Dickstein, and Samuel S. Schoenholz · 2021
Later among the works it cites.
Carbon emissions and large neural network training
David A. Patterson, Joseph Gonzalez, Quoc V. Le, Chen Liang, Lluis-Miquel Munguia, Daniel Rothchild, David R. So, Maud Texier, and Jeff Dean · 2021
Later among the works it cites.
Random features strengthen graph neural networks
R. Sato, Makoto Yamada, and Hisashi Kashima · 2021
Later among the works it cites.
E(n) equivariant graph neural networks, 2021
Victor Garcia Satorras, Emiel Hoogeboom, and Max Welling · 2021
Later among the works it cites.
Equivariant message passing for the prediction of tensorial properties and molecular spectra
Kristof Schütt, Oliver Unke, and Michael Gastegger · 2021
Later among the works it cites.
Learning gradient fields for molecular conformation generation
Chence Shi, Shitong Luo, Minkai Xu, and Jian Tang · 2021
Later among the works it cites.
Rotation invariant graph neural networks using spin convolutions
Muhammed Shuaibi, Adeesh Kolluru, Abhishek Das, Aditya Grover, Anuroop Sriram, Zachary Ulissi, and C Lawrence Zitnick · 2021
Later among the works it cites.
Bootstrapped representation learning on graphs
Shantanu Thakoor, Corentin Tallec, Mohammad Gheshlaghi Azar, Rémi Munos, Petar Velickovic, and Michal Valko · 2021
Later among the works it cites.
Self-supervised learning of graph neural networks: A unified review
Yaochen Xie, Zhao Xu, Zhengyang Wang, and Shuiwang Ji · 2021
Later among the works it cites.
Do transformers really perform bad for graph representation?
Chengxuan Ying, Tianle Cai, Shengjie Luo, Shuxin Zheng, Guolin Ke, Di He, Yanming Shen, and Tie-Yan Liu · 2021
Later among the works it cites.
Simple GNN regularisation for 3d molecular property prediction and beyond
Jonathan Godwin, Michael Schaarschmidt, Alexander L Gaunt, Alvaro Sanchez-Gonzalez, Yulia Rubanova, Petar Veličković, James Kirkpatrick, and Peter Battaglia · 2022
Closest in time.
Equivariant diffusion for molecule generation in 3d, 2022
Emiel Hoogeboom, Victor Garcia Satorras, Clément Vignac, and Max Welling · 2022
Closest in time.
Energy-motivated equivariant pretraining for 3d molecular graphs
Rui Jiao, Jiaqi Han, Wenbing Huang, Yu Rong, and Yang Liu · 2022
Closest in time.
Torchmd-net: Equivariant transformers for neural network based molecular potentials
Philipp Thölke and Gianni De Fabritiis · 2022
Closest in time.
Geodiff: A geometric diffusion model for molecular conformation generation
Minkai Xu, Lantao Yu, Yang Song, Chence Shi, Stefano Ermon, and Jian Tang · 2022
Closest in time.
Deep learning without shortcuts: Shaping the kernel with tailored rectifiers
Guodong Zhang, Aleksandar Botev, and James Martens · 2022
Closest in time.