Fetching the paper…
Reading the bibliography…
We present a novel neural network architecture using self-attention, the Wavefunction Transformer (Psiformer), which can be used as an approximation (or Ansatz) for solving the many-electron Schr\"odinger equation, the fundamental equation for quantum chemistry and material science.
An Undulatory Theory of the Mechanics of Atoms and Molecules
Erwin Schrödinger · 1926
Earlier work this paper cites.
Energy spectrum of the excitations in liquid helium
RP Feynman and Michael Cohen · 1956
Earlier work this paper cites.
On the Eigenfunctions of Many-Particle Systems in Quantum Mechanics
Tosio Kato · 1957
Earlier work this paper cites.
Dissociation Energies of the Benzene Dimer and Dimer Cation
J. R. Grover, E. A. Walters, and E. T. Hui · 1987
Earlier work this paper cites.
Binding Energies of Small Benzene Clusters
H. Krause, B. Ernstberger, and H. J. Neusser · 1991
Earlier work this paper cites.
Effects of Three-Body and Backflow Correlations in the Two-Dimensional Electron Gas
Yongkyung Kwon, DM Ceperley, and Richard M Martin · 1993
Earlier work this paper cites.
Atomic Ionization Potentials and Electron Affinities with Relativistic and Mass Corrections
Toshikatsu Koga, Hidenori Aoki, JM de la Vega, and Hiroshi Tatewaki · 1997
Earlier work this paper cites.
Green Function Monte Carlo with Stochastic Reconfiguration
Sandro Sorella · 1998
Earlier work this paper cites.
Assessment of gaussian-3 and density functional theories for a larger experimental test set
Larry A Curtiss, Krishnan Raghavachari, Paul C Redfern, and John A Pople · 2000
Earlier work this paper cites.
Quantum Monte Carlo Simulations of Solids
W. M. C. Foulkes, Lubos Mitas, R. J. Needs, and Guna Rajagopal · 2001
Earlier work this paper cites.
Jastrow Correlation Factor for Atoms, Molecules, and Solids
N. D. Drummond, M. D. Towler, and R. J. Needs · 2004
Earlier work this paper cites.
Weak Binding Between Two Aromatic Rings: Feeling the Van der Waals Attraction by Quantum Monte Carlo Methods
Sandro Sorella, Michele Casula, and Dario Rocca · 2007
Earlier work this paper cites.
Alleviation of the Fermion-Sign Problem by Optimization of Many-Body Wave Functions
C. J. Umrigar, Julien Toulouse, Claudia Filippi, Sandro Sorella, and Richard G. Hennig · 2007
Earlier work this paper cites.
Better, Faster Fermionic Neural Networks
James S. Spencer, David Pfau, Aleksandar Botev, and W. M. C. Foulkes · 2011
Earlier work this paper cites.
Modern Quantum Chemistry: Introduction to Advanced Electronic Structure Theory
Attila Szabo and Neil S. Ostlund · 2012
Earlier work this paper cites.
Molecular Electronic-Structure Theory
Trygve Helgaker, Poul Jorgensen, and Jeppe Olsen · 2014
Earlier work this paper cites.
Chemical Accuracy from Quantum Monte Carlo for the Benzene Dimer
Sam Azadi and R. E. Cohen · 2015
Earlier work this paper cites.
Optimizing Neural Networks with Kronecker-factored Approximate Curvature
James Martens and Roger Grosse · 2015
Earlier work this paper cites.
Iterative Backflow Renormalization Procedure for Many-Body Ground-State Wave Functions of Strongly Interacting Normal Fermi Liquids
Michele Taddei, Michele Ruggeri, Saverio Moroni, and Markus Holzmann · 2015
Earlier work this paper cites.
Jimmy Lei Ba, Jamie Ryan Kiros, and Geoffrey E Hinton · 2016
Cited alongside, same era.
Solving the Quantum Many-Body Problem with Artificial Neural Networks
Giuseppe Carleo and Matthias Troyer · 2017
Cited alongside, same era.
Attention is All You Need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin · 2017
Cited alongside, same era.
JAX: composable transformations of Python+NumPy programs, 2018
James Bradbury, Roy Frostig, Peter Hawkins, Matthew James Johnson, Chris Leary, Dougal Maclaurin, George Necula, Adam Paszke, Jake VanderPlas, Skye Wanderman-Milne, and Qiao Zhang · 2018
Cited alongside, same era.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova · 2018
Cited alongside, same era.
Ab-initio
David Pfau, James S. Spencer, Alexander G. G. Matthews, and W. M. C. Foulkes · 2020
Later among the works it cites.
Linformer: Self-Attention with Linear Complexity
Sinong Wang, Belinda Z Li, Madian Khabsa, Han Fang, and Hao Ma · 2020
Later among the works it cites.
Large Batch Optimization for Deep Learning: Training BERT in 76 Minutes
Yang You, Jing Li, Sashank Reddi, Jonathan Hseu, Sanjiv Kumar, Srinadh Bhojanapalli, Xiaodan Song, James Demmel, Kurt Keutzer, and Cho-Jui Hsieh · 2020
Later among the works it cites.
Highly Accurate Protein Structure Prediction with AlphaFold
John Jumper, Richard Evans, Alexander Pritzel, Tim Green, Michael Figurnov, Olaf Ronneberger, Kathryn Tunyasuvunakool, Russ Bates, Augustin Žídek, Anna Potapenko, et al · 2021
Later among the works it cites.
Pushing the Frontiers of Density Functionals by Solving the Fractional Electron Problem
James Kirkpatrick, Brendan McMorrow, David HP Turban, Alexander L. Gaunt, James S. Spencer, Alexander G. D. G. Matthews, Annette Obika, Louis Thiry, Meire Fortunato, David Pfau, et al · 2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Automatic Chemical Design Using a Data-Driven Continuous Representation of Molecules
Rafael Gómez-Bombarelli, Jennifer N. Wei, David Duvenaud, José Miguel Hernández-Lobato, Benjamín Sánchez-Lengeling, Dennis Sheberla, Jorge Aguilera-Iparraguirre, Timothy D. Hirzel, Ryan P. Adams, and Alán Aspuru-Guzik · 2018
Cited alongside, same era.
Schnet–a Deep Learning Architecture for Molecules and Materials
Kristof T Schütt, Huziel E Sauceda, P-J Kindermans, Alexandre Tkatchenko, and K-R Müller · 2018
Cited alongside, same era.
Planning Chemical Syntheses with Deep Neural Networks and Symbolic AI
Marwin H. S. Segler, Mike Preuss, and Mark P. Waller · 2018
Cited alongside, same era.
Generating Long Sequences with Sparse Transformers
Rewon Child, Scott Gray, Alec Radford, and Ilya Sutskever · 2019
Cited alongside, same era.
Solving Many-Electron Schrödinger Equation Using Deep Neural Networks
Jiequn Han, Linfeng Zhang, and E Weinan · 2019
Cited alongside, same era.
Backflow Transformations via Neural Networks for Quantum Many-Body Wave Functions
Di Luo and Bryan K Clark · 2019
Cited alongside, same era.
Which algorithmic choices matter at which batch sizes? Insights from a noisy quadratic model
Guodong Zhang, Lala Li, Zachary Nado, James Martens, Sushant Sachdeva, George Dahl, Chris Shallue, and Roger B Grosse · 2019
Cited alongside, same era.
Explicitly Antisymmetrized Neural Network Layers for Variational Monte Carlo Simulation
Jeffmin Lin, Gil Goldshlager, and Lin Lin · 2021
Later among the works it cites.
James Martens, Andy Ballard, Guillaume Desjardins, Grzegorz Swirszcz, Valentin Dalibard, Jascha Sohl-Dickstein, and Samuel S Schoenholz · 2021
Later among the works it cites.
Nyströmformer: A Nyström-Based Algorithm for Approximating Self-Attention
Yunyang Xiong, Zhanpeng Zeng, Rudrasis Chakraborty, Mingxing Tan, Glenn Fung, Yin Li, and Vikas Singh · 2021
Later among the works it cites.
E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials
Simon Batzner, Albert Musaelian, Lixin Sun, Mario Geiger, Jonathan P Mailoa, Mordechai Kornbluth, Nicola Molinari, Tess E. Smidt, and Boris Kozinsky · 2022
Closest in time.
KFAC-JAX, 2022
Aleksandar Botev and James Martens · 2022
Closest in time.
Discovering Quantum Phase Transitions with Fermionic Neural Networks
Gino Cassella, Halvard Sutterud, Sam Azadi, N. D. Drummond, David Pfau, James S. Spencer, and W. M. C. Foulkes · 2022
Closest in time.
FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
Tri Dao, Daniel Y Fu, Stefano Ermon, Atri Rudra, and Christopher Ré · 2022
Closest in time.
Sampling-Free Inference for Ab-initio Potential Energy Surface Networks
Nicholas Gao and Stephan Günnemann · 2022
Closest in time.
Gold-Standard Solutions to the Schrödinger Equation using Deep Learning: How Much Physics Do We Need?
Leon Gerard, Michael Scherbela, Philipp Marquetand, and Philipp Grohs · 2022
Closest in time.
Jan Hermann, James Spencer, Kenny Choo, Antonio Mezzacapo, W. M. C. Foulkes, David Pfau, Giuseppe Carleo, and Frank Noé · 2022
Closest in time.
Fermionic Neural Network with Effective Core Potential
Xiang Li, Cunwei Fan, Weiluo Ren, and Ji Chen · 2022
Closest in time.
Towards the Ground State of Molecules via Diffusion Monte Carlo on Neural Networks
Weiluo Ren, Weizhong Fu, and Ji Chen · 2022
Closest in time.
Completing Density Functional Theory by Machine-Learning Hidden Messages from Molecules
Ryo Nagai, Ryosuke Akashi, and Osamu Sugino · 2057
Closest in time.