Fetching the paper…
Reading the bibliography…
Although deep models have been widely explored in solving partial differential equations (PDEs), previous works are primarily limited to data only with up to tens of thousands of mesh points, far from the million-point scale required by industrial simulations that involve complex geometries.
Partial differential equations : methods and applications
Wazwaz, A. M · 2002
Earlier work this paper cites.
Neural operator: Graph kernel network for partial differential equations
Li, Z., Kovachki, N., Azizzadenesheli, K., Liu, B., Bhattacharya, K., Stuart, A., and Anandkumar, A · 2003
Earlier work this paper cites.
Neural operator: Graph kernel network for partial differential equations
Li, Z.-Y., Kovachki, N. B., Azizzadenesheli, K., Liu, B., Bhattacharya, K., Stuart, A., and Anandkumar, A · 2003
Earlier work this paper cites.
Finite element modeling of plasticity-induced crack closure with emphasis on geometry and mesh refinement effects
Solanki, K., Daniewicz, S., and Newman Jr, J · 2003
Earlier work this paper cites.
Partial differential equations and the finite element method
Ŝolín, P · 2005
Earlier work this paper cites.
Numerical treatment of partial differential equations
Grossmann, C., Roos, H.-G., and Stynes, M · 2007
Earlier work this paper cites.
Implementing spectral methods for partial differential equations: Algorithms for scientists and engineers
Kopriva, D. A · 2009
Earlier work this paper cites.
Bandwidth optimal all-reduce algorithms for clusters of workstations
Patarasuk, P. and Yuan, X · 2009
Earlier work this paper cites.
K-nearest neighbor
Peterson, L. E · 2009
Earlier work this paper cites.
Partial differential equations
Evans, L. C · 2010
Earlier work this paper cites.
Nonlinear partial differential equations with applications
Roubíček, T · 2013
Earlier work this paper cites.
Adam: A method for stochastic optimization
Kingma, D. P. and Ba, J · 2015
Earlier work this paper cites.
U-net: Convolutional networks for biomedical image segmentation
Ronneberger, O., Fischer, P., and Brox, T · 2015
Earlier work this paper cites.
Inductive representation learning on large graphs
Hamilton, W., Ying, Z., and Leskovec, J · 2017
Earlier work this paper cites.
Categorical reparameterization with gumbel-softmax
Jang, E., Gu, S., and Poole, B · 2017
Earlier work this paper cites.
Pointnet: Deep learning on point sets for 3d classification and segmentation
Qi, C. R., Su, H., Mo, K., and Guibas, L. J · 2017
Earlier work this paper cites.
Attention is all you need
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L. u., and Polosukhin, I · 2017
Earlier work this paper cites.
Graph u-nets
Gao, H. and Ji, S · 2019
Cited alongside, same era.
Gpipe: Efficient training of giant neural networks using pipeline parallelism
Huang, Y., Cheng, Y., Bapna, A., Firat, O., Chen, D., Chen, M., Lee, H., Ngiam, J., Le, Q. V., Wu, Y., et al · 2019
Cited alongside, same era.
Decoupled weight decay regularization
Loshchilov, I. and Hutter, F · 2019
Cited alongside, same era.
Megatron-lm: Training multi-billion parameter language models using model parallelism
Shoeybi, M., Patwary, M., Puri, R., LeGresley, P., Casper, J., and Catanzaro, B · 2019
Cited alongside, same era.
Reformer: The efficient transformer
Kitaev, N., Kaiser, L., and Levskaya, A · 2020
Cited alongside, same era.
Choose a transformer: Fourier or galerkin
Cao, S · 2021
Cited alongside, same era.
Jacobs, S. A., Tanaka, M., Zhang, C., Zhang, M., Song, S. L., Rajbhandari, S., and He, Y · 2023
Later among the works it cites.
On the prediction instability of graph neural networks
Klabunde, M. and Lemmerich, F · 2023
Later among the works it cites.
Neural operator: Learning maps between function spaces with applications to pdes
Kovachki, N., Li, Z., Liu, B., Azizzadenesheli, K., Bhattacharya, K., Stuart, A., and Anandkumar, A · 2023
Later among the works it cites.
Ring attention with blockwise transformers for near-infinite context
Liu, H., Zaharia, M., and Abbeel, P · 2023
Later among the works it cites.
Geometric instability of graph neural networks on large graphs
Morris, E., Shen, H., Du, W., Sajjad, M. H., and Shi, B · 2023
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Rethinking attention with performers
Choromanski, K., Likhosherstov, V., Dohan, D., Song, X., Gane, A., Sarlós, T., Hawkins, P., Davis, J., Mohiuddin, A., Kaiser, L., Belanger, D., Colwell, L. J., and Weller, A · 2021
Cited alongside, same era.
Fourier neural operator for parametric partial differential equations
Li, Z., Kovachki, N. B., Azizzadenesheli, K., liu, B., Bhattacharya, K., Stuart, A., and Anandkumar, A · 2021
Cited alongside, same era.
Learning mesh-based simulation with graph networks
Pfaff, T., Fortunato, M., Sanchez-Gonzalez, A., and Battaglia, P · 2021
Cited alongside, same era.
Flashattention: Fast and memory-efficient exact attention with io-awareness
Dao, T., Fu, D., Ermon, S., Rudra, A., and Ré, C · 2022
Cited alongside, same era.
Fourier neural operator with learned deformations for pdes on general geometries
Li, Z.-Y., Huang, D. Z., Liu, B., and Anandkumar, A · 2022
Cited alongside, same era.
HT-net: Hierarchical transformer based operator learning model for multiscale PDEs
Liu, X., Xu, B., and Zhang, L · 2022
Cited alongside, same era.
Later among the works it cites.
U-no: U-shaped neural operators
Rahman, M. A., Ross, Z. E., and Azizzadenesheli, K · 2023
Later among the works it cites.
Factorized fourier neural operators
Tran, A., Mathews, A., Xie, L., and Ong, C. S · 2023
Later among the works it cites.
Scientific discovery in the age of artificial intelligence
Wang, H., Fu, T., Du, Y., Gao, W., Huang, K., Liu, Z., Chandak, P., Liu, S., Van Katwyk, P., Deac, A., et al · 2023
Later among the works it cites.
Solving high-dimensional pdes with latent spectral models
Wu, H., Hu, T., Luo, H., Wang, J., and Long, M · 2023
Later among the works it cites.
On optimizing the communication of model parallelism
Zhuang, Y., Zheng, L., Li, Z., Xing, E., Ho, Q., Gonzalez, J., Stoica, I., Zhang, H., and Zhao, H · 2023
Later among the works it cites.
Geometry-guided conditional adaption for surrogate models of large-scale 3d PDEs on arbitrary geometries
Deng, J., Li, X., Xiong, H., Hu, X., and Ma, J · 2024
Later among the works it cites.
Elrefaie, M., Morar, F., Dai, A., and Ahmed, F · 2024
Later among the works it cites.
Latent neural operator for solving forward and inverse pde problems
Wang, T. and Wang, C · 2024
Later among the works it cites.
Transolver: A fast transformer solver for pdes on general geometries
Wu, H., Luo, H., Wang, H., Wang, J., and Long, M · 2024
Later among the works it cites.
Improved operator learning by orthogonal attention
Xiao, Z., Hao, Z., Lin, B., Deng, Z., and Su, H · 2024
Later among the works it cites.
Differential transformer, 2024
Ye, T., Dong, L., Xia, Y., Sun, Y., Zhu, Y., Huang, G., and Wei, F · 2024
Later among the works it cites.