SatMamba: Development of Foundation Models for Remote Sensing Imagery Using State Space Models

O. Ronneberger, P. Fischer, and T. Brox, “U-net: Convolutional networks for biomedical image segmentation,” in MICCAI , 2015

2015

Earlier work this paper cites.

G. Christie, N. Fendley, J. Wilson, and R. Mukherjee, “Functional Map of the World,” Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition , vol. 2, pp. 6172–6180, 2018

2018

Earlier work this paper cites.

P. Iakubovskii, “Segmentation Models Pytorch,” GitHub repository , 2019. [Online]. Available: https://github.com/qubvel/segmentation_models.pytorch

2019

Earlier work this paper cites.

R. Gupta, B. Goodman, N. Patel, R. Hosfelt, S. Sajeev, E. Heim, J. Doshi, K. Lucas, H. Choset, and M. Gaston, “Creating xbd: A dataset for assessing building damage from satellite imagery,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops , June 2019

2019

Earlier work this paper cites.

A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, J. Uszkoreit, and N. Houlsby, “An Image Is Worth 16X16 Words: Transformers for Image Recognition At Scale,” ICLR 2021 - 9th International Conference on Learning Representations , 2021

2021

Earlier work this paper cites.

Y. Cong, S. Khanna, C. Meng, P. Liu, E. Rozi, Y. He, M. Burke, D. B. Lobell, and S. Ermon, “SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery,” Advances in Neural Information Processing Systems , vol. 35, no. NeurIPS, pp. 1–24, 2022

2022

Earlier work this paper cites.

K. He, X. Chen, S. Xie, Y. Li, P. Dollar, and R. Girshick, “Masked Autoencoders Are Scalable Vision Learners,” Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition , vol. 2022-June, pp. 15 979–15 988, 2022

2022

Earlier work this paper cites.

J. Jakubik, S. Roy, C. E. Phillips, P. Fraccaro, D. Godwin, B. Zadrozny, D. Szwarcman, C. Gomes, G. Nyirjesy, B. Edwards, D. Kimura, N. Simumba, L. Chu, S. K. Mukkavilli, D. Lambhate, K. Das, R. Bangalore, D. Oliveira, M. Muszynski, K. Ankur, M. Ramasubramanian, I. Gurung, S. Khallaghi, H. S. Li, M. Cecil, M. Ahmadi, F. Kordi, H. Alemohammad, M. Maskey, and R. Ganti, “Foundation Models for Generalist Geospatial Artificial Intelligence,” arXiv , pp. 1–26, 2023

2023

Cited alongside, same era.

A. Gu and T. Dao, “Mamba: Linear-Time Sequence Modeling with Selective State Spaces,” arXiv , pp. 1–36, 2023. [Online]. Available: http://arxiv.org/abs/2312.00752

Original

2023

Cited alongside, same era.

I. Corley, C. Robinson, R. Dodhia, J. M. L. Ferres, and P. Najafirad, “Revisiting pre-trained remote sensing model benchmarks: resizing and normalization matters,” 2023. [Online]. Available: http://arxiv.org/abs/2305.13456

Original

2023

Cited alongside, same era.

J. Irvin, L. Tao, J. Zhou, Y. Ma, L. Nashold, B. Liu, and A. Y. Ng, “USat: A Unified Self-Supervised Encoder for Multi-Sensor Satellite Imagery,” arXiv , 2023. [Online]. Available: http://arxiv.org/abs/2312.02199

L. Zhu, B. Liao, Q. Zhang, X. Wang, W. Liu, and X. Wang, “Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model,” Proceedings of the 41 st International Conference on Machine Learning , vol. 235, pp. 62 429–62 442, 2024

2024

Later among the works it cites.

Y. Liu, Y. Tian, Y. Zhao, H. Yu, L. Xie, Y. Wang, Q. Ye, and Y. Liu, “VMamba: Visual State Space Model,” arXiv , 2024. [Online]. Available: http://arxiv.org/abs/2401.10166

Original

2024

Later among the works it cites.

H. Chen, J. Song, C. Han, J. Xia, and N. Yokoya, “ChangeMamba: Remote Sensing Change Detection with Spatiotemporal State Space Model,” IEEE Transactions on Geoscience and Remote Sensing , vol. 62, pp. 1–19, 2024

2024

Later among the works it cites.

C. Fibaek, L. Camilleri, A. Luyts, N. Dionelis, and B. L. Saux, “PhilEO Bench: Evaluating Geo-Spatial Foundation Models,” pp. 3–8, 2024. [Online]. Available: http://arxiv.org/abs/2401.04464

Original

2024

Later among the works it cites.