KAN-ODEs: Kolmogorov-Arnold Network Ordinary Differential Equations for Learning Dynamical Systems and Hidden Physics

doi:10.48550/arXiv.1906.02355

Original

X. Liu, T. Xiao, S. Si, Q. Cao, S. Kumar, C.-J. Hsieh, Neural SDE: Stabilizing Neural ODE Networks with Stochastic Noise, arXiv:1906.02355 (2019) · 1906

Earlier work this paper cites.

A. N. Kolmogorov, On the representation of continuous functions of several variables as superpositions of continuous functions of a smaller number of variables., Dokl. Akad. Nauk (108(2)) (1956)

1956

Earlier work this paper cites.

N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, R. Salakhutdinov, Dropout: A Simple Way to Prevent Neural Networks from Overfitting, Journal of Machine Learning Research 15 (56) (2014) 1929–1958

1958

Earlier work this paper cites.

doi:10.1016/0893-6080(89)90020-8

K. Hornik, M. Stinchcombe, H. White, Multilayer feedforward networks are universal approximators, Neural Networks 2 (5) (1989) 359–366 · 1989

Earlier work this paper cites.

G. Di Marzo, Rodas5 (4)-méthodes de rosenbrock d’ordre 5 (4) adaptées aux problemes différentiels-algébriques, MSc Mathematics Thesis (1993)

1993

Earlier work this paper cites.

doi:10.1016/0168-9274(95)00117-4

T. Maly, L. R. Petzold, Numerical methods and software for sensitivity analysis of differential-algebraic systems, Appl. Numer. Math. 20 (1-2) (1996) 57–79 · 1996

Earlier work this paper cites.

doi:10.48550/arXiv.2001.04385

Original

C. Rackauckas, Y. Ma, J. Martensen, C. Warner, K. Zubov, R. Supekar, D. Skinner, A. Ramadhan, A. Edelman, Universal Differential Equations for Scientific Machine Learning, arXiv:2001.04385 (2021) · 2001

Earlier work this paper cites.

doi:10.1016/S0377-0427(02)00528-9

Y. Cao, S. Li, L. Petzold, Adjoint sensitivity analysis for differential-algebraic equations: algorithms and software, J. Comput. Appl. Math. 149 (1) (2002) 171–191 · 2002

Earlier work this paper cites.

doi:10.1137/S1064827501380630

Y. Cao, S. Li, L. Petzold, R. Serban, Adjoint sensitivity analysis for differential-algebraic equations: The adjoint dae system and its numerical solution, SIAM J. Sci. Comput. 24 (3) (2003) 1076–1089 · 2003

Earlier work this paper cites.

doi:10.1016/j.camwa.2011.06.002

C. Tsitouras, Runge–Kutta pairs of order 5(4) satisfying only the first column simplifying assumption, Computers & Mathematics with Applications 62 (2) (2011) 770–775 · 2011

Earlier work this paper cites.

doi:10.48550/arXiv.2012.07244

Original

R. Dandekar, K. Chung, V. Dixit, M. Tarek, A. Garcia-Valadez, K. V. Vemula, C. Rackauckas, Bayesian Neural Ordinary Differential Equations, arXiv:2012.07244 (2022) · 2012

Earlier work this paper cites.

doi:10.1073/pnas.1517384113

S. L. Brunton, J. L. Proctor, J. N. Kutz, Discovering governing equations from data by sparse identification of nonlinear dynamical systems, Proceedings of the National Academy of Sciences 113 (15) (2016) 3932–3937 · 2016

Earlier work this paper cites.

doi:10.1073/pnas.1517384113

S. L. Brunton, J. L. Proctor, J. N. Kutz, Discovering governing equations from data by sparse identification of nonlinear dynamical systems, Proceedings of the National Academy of Sciences 113 (15) (2016) 3932–3937 · 2016

Earlier work this paper cites.

doi:10.1126/sciadv.1602614

S. H. Rudy, S. L. Brunton, J. L. Proctor, J. N. Kutz, Data-driven discovery of partial differential equations, Science Advances 3 (4) (2017) e1602614 · 2017

Earlier work this paper cites.

doi:10.1088/1361-6420/aa9a90

E. Haber, L. Ruthotto, Stable architectures for deep neural networks, Inverse problems 34 (1) (2017) 014004 · 2017

Earlier work this paper cites.

doi:10.48550/arXiv.1710.05941

Original

P. Ramachandran, B. Zoph, Q. V. Le, Searching for Activation Functions, arXiv:1710.05941 (2017) · 2017

Earlier work this paper cites.

doi:10.5334/jors.151

C. Rackauckas, Q. Nie, DifferentialEquations.jl – A Performant and Feature-Rich Ecosystem for Solving Differential Equations in Julia, Journal of Open Research Software 5 (1) (2017) · 2017

Earlier work this paper cites.

doi:10.48550/arXiv.1412.6980

Original

D. P. Kingma, J. Ba, Adam: A Method for Stochastic Optimization, arXiv:1412.6980 (2017) · 2017

Cited alongside, same era.

doi:10.1016/j.jcp.2018.10.045

M. Raissi, P. Perdikaris, G. E. Karniadakis, Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations, Journal of Computational Physics 378 (2019) 686–707 · 2018

Cited alongside, same era.

Y. Lu, A. Zhong, Q. Li, B. Dong, Beyond finite layer neural networks: Bridging deep architectures and numerical differential equations, in: International Conference on Machine Learning, PMLR, 2018, pp. 3276–3285

2018

Cited alongside, same era.

doi:10.1098/rspa.2018.0335

E. Kaiser, J. N. Kutz, S. L. Brunton, Sparse identification of nonlinear dynamics for model predictive control in the low-data limit, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences 474 (2219) (2018) 20180335 · 2018

Cited alongside, same era.

doi:10.48550/arXiv.1806.07366

doi:10.1016/j.combustflame.2022.111992

W. Ji, F. Richter, M. J. Gollner, S. Deng, Autonomous kinetic modeling of biomass pyrolysis using chemical reaction neural networks, Combustion and Flame 240 (2022) 111992 · 2022

Later among the works it cites.

doi:10.3390/s23052792

S. Alkhadhr, M. Almekkawy, Wave Equation Modeling via Physics-Informed Neural Networks: Models of Soft and Hard Constraints for Initial and Boundary Conditions, Sensors 23 (5) (2023) 2792 · 2023

Later among the works it cites.

doi:10.1016/j.jpowsour.2023.233443

B. C. Koenig, P. Zhao, S. Deng, Accommodating physical reaction schemes in DSC cathode thermal stability analysis using chemical reaction neural networks, Journal of Power Sources 581 (2023) 233443 · 2023

Later among the works it cites.

doi:10.1039/D2CP05083H

Q. Li, H. Chen, B. C. Koenig, S. Deng, Bayesian chemical reaction neural network for autonomous kinetic uncertainty quantification, Physical Chemistry Chemical Physics 25 (5) (2023) 3707–3717 · 2023

Later among the works it cites.

doi:10.1016/j.cej.2023.143779

S. Kim, S. Deng, Inference of chemical kinetics and thermodynamic properties from constant-volume combustion of energetic materials, Chemical Engineering Journal 469 (2023) 143779 · 2023

Later among the works it cites.