Fetching the paper…
Reading the bibliography…
Can we build a single large model for a wide range of PDE-related scientific learning tasks? Can this model generalize to new PDEs, even of new forms, without any fine-tuning? In-context operator learning and the corresponding model In-Context Operator Networks (ICON) represent an initial exploration of these questions.
Weighted essentially non-oscillatory schemes
Xu-Dong Liu, Stanley Osher, and Tony Chan · 1994
Earlier work this paper cites.
Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems
Tianping Chen and Hong Chen · 1995
Earlier work this paper cites.
Approximation capability to functions of several variables, nonlinear functionals, and operators by radial basis function neural networks
Tianping Chen and Hong Chen · 1995
Earlier work this paper cites.
Artificial neural networks for solving ordinary and partial differential equations
Isaac E Lagaris, Aristidis Likas, and Dimitrios I Fotiadis · 1998
Earlier work this paper cites.
Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
Weinan E, Jiequn Han, and Arnulf Jentzen · 2017
Earlier work this paper cites.
Solving high-dimensional partial differential equations using deep learning
Jiequn Han, Arnulf Jentzen, and Weinan E · 2018
Earlier work this paper cites.
DGM: a deep learning algorithm for solving partial differential equations
Justin Sirignano and Konstantinos Spiliopoulos · 2018
Earlier work this paper cites.
The deep Ritz method: a deep learning-based numerical algorithm for solving variational problems
Weinan E and Bing Yu · 2018
Earlier work this paper cites.
Bayesian deep convolutional encoder–decoder networks for surrogate modeling and uncertainty quantification
Yinhao Zhu and Nicholas Zabaras · 2018
Earlier work this paper cites.
PDE-net: Learning PDEs from data
Zichao Long, Yiping Lu, Xianzhong Ma, and Bin Dong · 2018
Earlier work this paper cites.
Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations
M. Raissi, P. Perdikaris, and G. E. Karniadakis · 2019
Earlier work this paper cites.
Language models are unsupervised multitask learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al · 2019
Earlier work this paper cites.
Weak adversarial networks for high-dimensional partial differential equations
Yaohua Zang, Gang Bao, Xiaojing Ye, and Haomin Zhou · 2020
Earlier work this paper cites.
Potential flow generator with L 2 {L}_{2} optimal transport regularity for generative models
Liu Yang and George Em Karniadakis · 2020
Earlier work this paper cites.
A machine learning framework for solving high-dimensional mean field game and mean field control problems
Lars Ruthotto, Stanley J. Osher, Wuchen Li, Levon Nurbekyan, and Samy Wu Fung · 2020
Earlier work this paper cites.
Learning to simulate complex physics with graph networks
Alvaro Sanchez-Gonzalez, Jonathan Godwin, Tobias Pfaff, Rex Ying, Jure Leskovec, and Peter Battaglia · 2020
Earlier work this paper cites.
Learning mesh-based simulation with graph networks
Tobias Pfaff, Meire Fortunato, Alvaro Sanchez-Gonzalez, and Peter Battaglia · 2020
Earlier work this paper cites.
Transfer learning enhanced physics informed neural network for phase-field modeling of fracture
Somdatta Goswami, Cosmin Anitescu, Souvik Chakraborty, and Timon Rabczuk · 2020
Earlier work this paper cites.
Language models are few-shot learners
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al · 2020
Earlier work this paper cites.
Alternating the population and control neural networks to solve high-dimensional stochastic mean-field games
Alex Tong Lin, Samy Wu Fung, Wuchen Li, Levon Nurbekyan, and Stanley J. Osher · 2021
Earlier work this paper cites.
Solving parametric PDE problems with artificial neural networks
Yuehaw Khoo, Jianfeng Lu, and Lexing Ying · 2021
Cited alongside, same era.
Fourier neural operator for parametric partial differential equations
Zongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede liu, Kaushik Bhattacharya, Andrew Stuart, and Anima Anandkumar · 2021
Cited alongside, same era.
Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators
Lu Lu, Pengzhan Jin, Guofei Pang, Zhongqiang Zhang, and George Em Karniadakis · 2021
Cited alongside, same era.
Learning the solution operator of parametric partial differential equations with physics-informed DeepONets
Sifan Wang, Hanwen Wang, and Paris Perdikaris · 2021
Cited alongside, same era.
Model reduction and neural networks for parametric PDEs
Kaushik Bhattacharya, Bamdad Hosseini, Nikola B Kovachki, and Andrew M Stuart · 2021
Cited alongside, same era.
What can transformers learn in-context? a case study of simple function classes
Shivam Garg, Dimitris Tsipras, Percy S Liang, and Gregory Valiant · 2022
Later among the works it cites.
A survey for in-context learning
Qingxiu Dong, Lei Li, Damai Dai, Ce Zheng, Zhiyong Wu, Baobao Chang, Xu Sun, Jingjing Xu, and Zhifang Sui · 2022
Later among the works it cites.
Chain-of-thought prompting elicits reasoning in large language models
Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al · 2022
Later among the works it cites.
Neural operator: Learning maps between function spaces with applications to PDEs
Nikola Kovachki, Zongyi Li, Burigede Liu, Kamyar Azizzadenesheli, Kaushik Bhattacharya, Andrew Stuart, and Anima Anandkumar · 2023
Later among the works it cites.
Reliable extrapolation of deep neural operators informed by physics or sparse observations
Min Zhu, Handi Zhang, Anran Jiao, George Em Karniadakis, and Lu Lu · 2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Zongyi Li, Hongkai Zheng, Nikola Kovachki, David Jin, Haoxuan Chen, Burigede Liu, Kamyar Azizzadenesheli, and Anima Anandkumar · 2021
Cited alongside, same era.
Message passing neural pde solvers
Johannes Brandstetter, Daniel E Worrall, and Max Welling · 2021
Cited alongside, same era.
Machine learning–accelerated computational fluid dynamics
Dmitrii Kochkov, Jamie A Smith, Ayya Alieva, Qing Wang, Michael P Brenner, and Stephan Hoyer · 2021
Cited alongside, same era.
Transfer learning for deep neural network-based partial differential equations solving
Xinhai Chen, Chunye Gong, Qian Wan, Liang Deng, Yunbo Wan, Yang Liu, Bo Chen, and Jie Liu · 2021
Cited alongside, same era.
A physics-informed deep learning framework for inversion and surrogate modeling in solid mechanics
Ehsan Haghighat, Maziar Raissi, Adrian Moure, Hector Gomez, and Ruben Juanes · 2021
Cited alongside, same era.
Unsupervised reservoir computing for solving ordinary differential equations
Marios Mattheakis, Hayden Joy, and Pavlos Protopapas · 2021
Cited alongside, same era.
Transfer learning based multi-fidelity physics informed deep neural network
Souvik Chakraborty · 2021
Cited alongside, same era.
Explaining the physics of transfer learning in data-driven turbulence modeling
Adam Subel, Yifei Guan, Ashesh Chattopadhyay, and Pedram Hassanzadeh · 2023
Later among the works it cites.
Transfer learning based physics-informed neural networks for solving inverse problems in engineering structures under different loading scenarios
Chen Xu, Ba Trung Cao, Yong Yuan, and Günther Meschke · 2023
Later among the works it cites.
Transfer learning enhanced DeepONet for long-time prediction of evolution equations
Wuzhe Xu, Yulong Lu, and Li Wang · 2023
Later among the works it cites.
Yanfang Lyu, Xiaoyu Zhao, Zhiqiang Gong, Xiao Kang, and Wen Yao · 2023
Later among the works it cites.
Shashank Subramanian, Peter Harrington, Kurt Keutzer, Wahid Bhimji, Dmitriy Morozov, Michael Mahoney, and Amir Gholami · 2023
Later among the works it cites.
In-context operator learning with data prompts for differential equation problems
Liu Yang, Siting Liu, Tingwei Meng, and Stanley J Osher · 2023
Later among the works it cites.
Fine-tune language models as multi-modal differential equation solvers
Liu Yang, Siting Liu, and Stanley J Osher · 2023
Later among the works it cites.
Prose: Predicting operators and symbolic expressions using multimodal transformers
Yuxuan Liu, Zecheng Zhang, and Hayden Schaeffer · 2023
Later among the works it cites.
Does in-context operator learning generalize to domain-shifted settings?
Jerry Weihong Liu, N Benjamin Erichson, Kush Bhatia, Michael W Mahoney, and Christopher Re · 2023
Later among the works it cites.
Multiple physics pretraining for physical surrogate models
Michael McCabe, Bruno Régaldo-Saint Blancard, Liam Holden Parker, Ruben Ohana, Miles Cranmer, Alberto Bietti, Michael Eickenberg, Siavash Golkar, Geraud Krawezik, Francois Lanusse, et al · 2023
Later among the works it cites.
Sequential modeling enables scalable learning for large vision models
Yutong Bai, Xinyang Geng, Karttikeya Mangalam, Amir Bar, Alan Yuille, Trevor Darrell, Jitendra Malik, and Alexei A Efros · 2023
Later among the works it cites.
Haotian Liu, Chunyuan Li, Qingyang Wu, and Yong Jae Lee · 2023
Later among the works it cites.
Palm-e: An embodied multimodal language model
Danny Driess, Fei Xia, Mehdi SM Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, et al · 2023
Later among the works it cites.
GPT-4 technical report, 2023
OpenAI · 2023
Later among the works it cites.