Fetching the paper…
Reading the bibliography…
We consider neural networks with rational activation functions.
Nonlinear Programming
Harold W. Kuhn and Albert W. Tucker · 1951
Earlier work this paper cites.
Rational approximation to
Donald J. Newman · 1964
Earlier work this paper cites.
On the uniform approximation of
N. S. Vyacheslavov · 1975
Earlier work this paper cites.
On a Zolotarev problem in the method of alternating directions
V. I. Lebedev · 1977
Earlier work this paper cites.
Optimal nonlinear approximation
Ronald A. DeVore, Ralph Howard, and Charles Micchelli · 1989
Earlier work this paper cites.
Learning Long-Term Dependencies with Gradient Descent is Difficult
Yoshua Bengio, Patrice Simard, and Paolo Frasconi · 1994
Earlier work this paper cites.
Neural Networks for Optimal Approximation of Smooth and Analytic Functions
Hrushikesh N. Mhaskar · 1996
Earlier work this paper cites.
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner · 1998
Earlier work this paper cites.
Learning and approximation capabilities of adaptive spline activation function neural networks
Lorenzo Vecci, Francesco Piazza, and Aurelio Uncini · 1998
Earlier work this paper cites.
Multilayer feedforward networks with adaptive spline activation function
Stefano Guarnieri, Francesco Piazza, and Aurelio Uncini · 1999
Earlier work this paper cites.
Constructive feedforward neural networks using Hermite polynomial activation functions
Liying Ma and Khashayar Khorasani · 2005
Earlier work this paper cites.
Imagenet: A large-scale hierarchical image database
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei · 2009
Earlier work this paper cites.
What is the best multi-stage architecture for object recognition?
Kevin Jarrett, Koray Kavukcuoglu, Marc’Aurelio Ranzato, and Yann LeCun · 2009
Earlier work this paper cites.
Barycentric-Remez algorithms for best polynomial approximation in the chebfun system
Ricardo Pachón and Lloyd N Trefethen · 2009
Earlier work this paper cites.
Functional Analysis, Sobolev Spaces and Partial Differential Equations
Haim Brezis · 2010
Earlier work this paper cites.
Rectified Linear Units Improve Restricted Boltzmann Machines
Vinod Nair and Geoffrey E. Hinton · 2010
Earlier work this paper cites.
Deep Sparse Rectifier Neural Networks
Xavier Glorot, Antoine Bordes, and Yoshua Bengio · 2011
Earlier work this paper cites.
Rational Approximation of Real Functions
Penco P. Petrushev and Vasil A. Popov · 2011
Earlier work this paper cites.
Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups
Geoffrey Hinton, Li Deng, Dong Yu, George E. Dahl, Abdel-rahman Mohamed, Navdeep Jaitly, Andrew Senior, Vincent Vanhoucke, Patrick Nguyen, Tara N. Sainath, et al · 2012
Earlier work this paper cites.
ImageNet Classification with Deep Convolutional Neural Networks
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton · 2012
Earlier work this paper cites.
Theory of Approximation
Naum I. Achieser · 2013
Cited alongside, same era.
Rectifier Nonlinearities Improve Neural Network Acoustic Models
Andrew L. Maas, Awni Y. Hannun, and Andrew Y. Ng · 2013
Cited alongside, same era.
Approximation Theory and Approximation Practice
Lloyd N. Trefethen · 2013
Cited alongside, same era.
Chebfun Guide, 2014
Tobin A. Driscoll, Nicholas Hale, and Lloyd N. Trefethen · 2014
Cited alongside, same era.
Generative Adversarial Nets
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio · 2014
Cited alongside, same era.
Adam: A method for stochastic optimization
Diederik P. Kingma and Jimmy Ba · 2014
Cited alongside, same era.
Self-Normalizing Neural Networks
Günter Klambauer, Thomas Unterthiner, Andreas Mayr, and Sepp Hochreiter · 2017
Later among the works it cites.
Conditional image synthesis with auxiliary classifier GANs
Augustus Odena, Christopher Olah, and Jonathon Shlens · 2017
Later among the works it cites.
Searching for Activation Functions
Prajit Ramachandran, Barret Zoph, and Quoc V. Le · 2017
Later among the works it cites.
Neural networks and rational functions
Matus Telgarsky · 2017
Later among the works it cites.
Error bounds for approximations with deep ReLU networks
Dmitry Yarotsky · 2017
Later among the works it cites.
Rational Neural Networks for Approximating Graph Convolution Operator on Jump Discontinuities
Zhiqian Chen, Feng Chen, Rongjie Lai, Xuchao Zhang, and Chang-Tien Lu · 2018
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Djork-Arné Clevert, Thomas Unterthiner, and Sepp Hochreiter · 2015
Cited alongside, same era.
Delving deep into rectifiers: Surpassing human-level performance on imagenet classification
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun · 2015
Cited alongside, same era.
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Sergey Ioffe and Christian Szegedy · 2015
Cited alongside, same era.
Deep learning
Yann LeCun, Yoshua Bengio, and Geoffrey Hinton · 2015
Cited alongside, same era.
Deep neural nets as a method for quantitative structure–activity relationships
Junshui Ma, Robert P. Sheridan, Andy Liaw, George E. Dahl, and Vladimir Svetnik · 2015
Cited alongside, same era.
Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
Alec Radford, Luke Metz, and Soumith Chintala · 2015
Cited alongside, same era.
Later among the works it cites.
Polynomial Regression As an Alternative to Neural Nets
Xi Cheng, Bohdan Khomtchouk, Norman Matloff, and Pete Mohanty · 2018
Later among the works it cites.
Rational Minimax Approximation via Adaptive Barycentric Representations
Silviu-Ioan Filip, Yuji Nakatsukasa, Lloyd N. Trefethen, and Bernhard Beckermann · 2018
Later among the works it cites.
Deep hidden physics models: Deep learning of nonlinear partial differential equations
Maziar Raissi · 2018
Later among the works it cites.
https://github.com/keras-team/keras , 2019
Keras GitHub repository, · 2019
Later among the works it cites.
A Polynomial-Based Approach for Architectural Design and Learning with Deep Neural Networks
Joseph Daws Jr. and Clayton G. Webster · 2019
Later among the works it cites.
Learning Activation Functions: A new paradigm of understanding Neural Networks
Mohit Goyal, Rajan Goyal, and Brejesh Lall · 2019
Later among the works it cites.
Padé Activation Units: End-to-end Learning of Flexible Activation Functions in Deep Networks
Alejandro Molina, Patrick Schramowski, and Kristian Kersting · 2019
Later among the works it cites.
Deep ReLU networks overcome the curse of dimensionality for bandlimited functions
Hadrien Montanelli, Haizhao Yang, and Qiang Du · 2019
Later among the works it cites.
Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
Maziar Raissi, Paris Perdikaris, and George E. Karniadakis · 2019
Later among the works it cites.
GitHub repository
Nicolas Boullé, Yuji Nakatsukasa, and Alex Townsend · 2020
Closest in time.
A deep learning framework for solution and discovery in solid mechanics: linear elasticity
Ehsan Haghighat, Maziar Raissi, Adrian Moure, Hector Gomez, and Ruben Juanes · 2020
Closest in time.
Adaptive activation functions accelerate convergence in deep and physics-informed neural networks
Ameya D. Jagtap, Kenji Kawaguchi, and George E. Karniadakis · 2020
Closest in time.
GitHub repository
Maziar Raissi · 2020
Closest in time.
Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations
Maziar Raissi, Alireza Yazdani, and George E. Karniadakis · 2020
Closest in time.