When are Foundation Models Effective? Understanding the Suitability for Pixel-Level Classification Using Multispectral Imagery

O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” in Medical image computing and computer-assisted intervention–MICCAI 2015: 18th into. conf., Munich, Germany, proc., part III 18 . Springer, 2015, pp. 234–241

2015

Earlier work this paper cites.

T. Chen and C. Guestrin, “Xgboost: A scalable tree boosting system,” in Proc. of the 22nd acm sigkdd intl. conf. on knowledge discovery and data mining , 2016, pp. 785–794

2016

Earlier work this paper cites.

P. G. Curtis, C. M. Slay, N. L. Harris et al. , “Classifying drivers of global forest loss,” Science , vol. 361, no. 6407, pp. 1108–1111, 2018

2018

Earlier work this paper cites.

L.-C. Chen, Y. Zhu, G. Papandreou, F. Schroff, and H. Adam, “Encoder-decoder with atrous separable convolution for semantic image segmentation,” in Proc. of the European conf. on computer vision (ECCV) , 2018, pp. 801–818

2018

Earlier work this paper cites.

Z. Li, N. Kovachki, K. Azizzadenesheli, B. Liu, K. Bhattacharya, A. Stuart, and A. Anandkumar, “Fourier neural operator for parametric partial differential equations,” arXiv preprint arXiv:2010.08895 , 2020

Original

2020

Earlier work this paper cites.

A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly et al. , “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv:2010.11929 , 2020

Original

2020

Earlier work this paper cites.

D. Bonafilia, B. Tellman, T. Anderson, and E. Issenberg, “Sen1floods11: A georeferenced dataset to train and test deep learning flood algorithms for sentinel-1,” in Proc. of the IEEE/CVF Conf. on Computer Vision and Pattern Recognition Workshops , 2020, pp. 210–211

2020

Earlier work this paper cites.

F. Wei, Y. Gao, Z. Wu, H. Hu, and S. Lin, “Aligning pretraining for detection via object-level contrastive learning,” Advances in Neural Information Processing Systems , vol. 34, pp. 22 682–22 694, 2021

2021

Cited alongside, same era.

E. Xie, W. Wang, Z. Yu, A. Anandkumar, J. M. Alvarez, and P. Luo, “Segformer: Simple and efficient design for semantic segmentation with transformers,” Advances in neural information processing systems , vol. 34, pp. 12 077–12 090, 2021

2021

Cited alongside, same era.

K. He, X. Chen, S. Xie et al. , “Masked autoencoders are scalable vision learners,” in Proc. of the IEEE/CVF conf. on computer vision and pattern recognition , 2022, pp. 16 000–16 009

2022

Cited alongside, same era.

J. Pathak, S. Subramanian, P. Harrington et al. , “Fourcastnet: A global data-driven high-resolution weather model using adaptive fourier neural operators,” arXiv preprint arXiv:2202.11214 , 2022

Original

2022

Cited alongside, same era.

J. Jakubik, M. Muszynski, M. Vössing, N. Kühl, and T. Brunschwiler, “Toward foundation models for earth monitoring: Generalizable deep learning models for natural hazard segmentation,” in IEEE IGARSS 2023 , 2023, pp. 5638–5641

2023

Later among the works it cites.

P. Dias, A. Potnis, S. Guggilam, L. Yang, A. Tsaris, H. Medeiros, and D. Lunga, “An agenda for multimodal foundation models for earth observation,” in IGARSS 2023-2023 IEEE Intl. Geoscience and Remote Sensing Symposium . IEEE, 2023, pp. 1237–1240

2023

Later among the works it cites.

J. Jakubik, S. Roy, C. Phillips, P. Fraccaro, D. Godwin, B. Zadrozny, D. Szwarcman, C. Gomes, G. Nyirjesy, B. Edwards et al. , “Foundation models for generalist geospatial artificial intelligence,” arXiv preprint arXiv:2310.18660 , 2023

Original

2023

Later among the works it cites.

J. Jakubik, L. Chu, P. Fraccaro et al. , “Prithvi-100M,” Aug. 2023

2023

Later among the works it cites.