Fetching the paper…
Reading the bibliography…
Foundation models have enormous potential in advancing Earth and climate sciences, however, current approaches may not be optimal as they focus on a few basic features of a desirable Earth and climate foundation model.
Slonecker, E.T., Shaw, D.M., Lillesand, T.M.: Emerging legal and ethical issues in advanced remote sensing technology. Photogrammetric Engineering and Remote Sensing 64
1998
Earlier work this paper cites.
Snelson, E., Ghahramani, Z.: Sparse Gaussian processes using pseudo-inputs. In: Advances in Neural Information Processing Systems, vol. 18 (2005)
2005
Earlier work this paper cites.
Malenovskỳ, Z., Rott, H., Cihlar, J., Schaepman, M.E., García-Santos, G., Fernandes, R., Berger, M.: Sentinels for science: Potential of Sentinel-1,-2, and-3 missions for scientific observations of ocean, cryosphere, and land. Remote Sensing of environment 120
2012
Earlier work this paper cites.
Kobayashi, S., Ota, Y., Harada, Y., Ebita, A., Moriya, M., Onoda, H., Onogi, K., Kamahori, H., Kobayashi, C., Endo, H., et al
2015
Earlier work this paper cites.
Wedi, N., Bauer, P., Denoninck, W., Diamantakis, M., Hamrud, M., Kuhnlein, C., Malardel, S., Mogensen, K., Mozdzynski, G., Smolarkiewicz, P.: The modelling infrastructure of the Integrated Forecasting System: Recent advances and future challenges (2015)
2015
Earlier work this paper cites.
Cao, Y., Yang, J.: Towards making systems forget with machine unlearning. In: IEEE Symposium on Security and Privacy, pp. 463–480 (2015)
2015
Earlier work this paper cites.
O’Neill, B.C., Tebaldi, C., Van Vuuren, D.P., Eyring, V., Friedlingstein, P., Hurtt, G., Knutti, R., Kriegler, E., Lamarque, J.-F., Lowe, J., et al
2016
Earlier work this paper cites.
Zhang, J., Howard, K., Langston, C., Kaney, B., Qi, Y., Tang, L., Grams, H., Wang, Y., Cocks, S., Martinaitis, S., Arthur, A., Cooper, K., Brogden, J., Kitzmiller, D.: Multi-radar multi-sensor (MRMS) quantitative precipitation estimation: Initial operating capabilities. Bulletin of the American Meteorological Society 97
2016
Earlier work this paper cites.
Qu, B., Li, X., Tao, D., Lu, X.: Deep semantic understanding of high resolution remote sensing image. In: International Conference on Computer, Information and Telecommunication Systems, pp. 1–5 (2016)
2016
Earlier work this paper cites.
Zhu, X.X., Tuia, D., Mou, L., Xia, G.-S., Zhang, L., Xu, F., Fraundorfer, F.: Deep learning in remote sensing: A comprehensive review and list of resources. IEEE Geoscience and Remote Sensing Magazine 5
2017
Earlier work this paper cites.
Gelaro, R., McCarty, W., Suárez, M.J., Todling, R., Molod, A., Takacs, L., Randles, C.A., Darmenov, A., Bosilovich, M.G., Reichle, R., et al
2017
Earlier work this paper cites.
OpenStreetMap contributors: Planet dump retrieved from https://planet.osm.org . https://www.openstreetmap.org (2017)
2017
Earlier work this paper cites.
Kirkpatrick, J., Pascanu, R., Rabinowitz, N., Veness, J., Desjardins, G., Rusu, A.A., Milan, K., Quan, J., Ramalho, T., Grabska-Barwinska, A., et al
2017
Earlier work this paper cites.
Racah, E., Beckham, C., Maharaj, T., Ebrahimi Kahou, S., Prabhat, M., Pal, C.: ExtremeWeather: A large-scale climate dataset for semi-supervised detection, localization, and understanding of extreme weather events. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
2017
Earlier work this paper cites.
Soille, P., Burger, A., De Marchi, D., Kempeneers, P., Rodriguez, D., Syrris, V., Vasilev, V.: A versatile data-intensive computing platform for information retrieval from big geospatial data. Future Generation Computer Systems 81
2018
Earlier work this paper cites.
Hersbach, H., Bell, B., Berrisford, P., Biavati, G., Horányi, A., Muñoz Sabater, J., Nicolas, J., Peubey, C., Radu, R., Rozum, I., et al.: ERA5 hourly data on single levels from 1940 to present. Copernicus Climate Change Service Climate Data Store (2018)
2018
Earlier work this paper cites.
Kalnay, E., Kanamitsu, M., Kistler, R., Collins, W., Deaven, D., Gandin, L., Iredell, M., Saha, S., White, G., Woollen, J., et al.: The NCEP/NCAR 40-year reanalysis project. Renewable Energy, 146–194 (2018)
2018
Earlier work this paper cites.
Xia, G.-S., Bai, X., Ding, J., Zhu, Z., Belongie, S., Luo, J., Datcu, M., Pelillo, M., Zhang, L.: DOTA: A large-scale dataset for object detection in aerial images. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3974–3983 (2018)
2018
Earlier work this paper cites.
Lu, X., Wang, B., Zheng, X., Li, X.: Exploring models and data for remote sensing image caption generation. IEEE Transactions on Geoscience and Remote Sensing 56
2018
Earlier work this paper cites.
Strubell, E., Ganesh, A., McCallum, A.: Energy and policy considerations for deep learning in NLP. In: Proceedings of the Annual Meeting of the Association for Computational Linguistics, pp. 3645–3650 (2019)
2019
Earlier work this paper cites.
Sumbul, G., Charfuelan, M., Demir, B., Markl, V.: BigEarthNet: A large-scale benchmark archive for remote sensing image understanding. In: IEEE International Geoscience and Remote Sensing Symposium, pp. 5901–5904 (2019)
2019
Earlier work this paper cites.
Jean, N., Wang, S., Samar, A., Azzari, G., Lobell, D., Ermon, S.: Tile2Vec: Unsupervised representation learning for spatially distributed data. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 3967–3974 (2019)
2019
Earlier work this paper cites.
Petrie, R., Denvil, S., Ames, S., Levavasseur, G., Fiore, S., Allen, C., Antonio, F., Berger, K., Bretonnière, P.-A., Cinquini, L., et al
2020
Earlier work this paper cites.
Hersbach, H., Bell, B., Berrisford, P., Hirahara, S., Horányi, A., Muñoz-Sabater, J., Nicolas, J., Peubey, C., Radu, R., Schepers, D., et al
2020
Earlier work this paper cites.
Xiong, Z., Yuan, Y., Wang, Q.: MSN: Modality separation networks for RGB-D scene recognition. Neurocomputing 373
2020
Earlier work this paper cites.
Rasp, S., Dueben, P.D., Scher, S., Weyn, J.A., Mouatadid, S., Thuerey, N.: WeatherBench: A benchmark data set for data-driven weather forecasting. Journal of Advances in Modeling Earth Systems 12
2020
Earlier work this paper cites.
2020
Earlier work this paper cites.
Feldman, V.: Does learning require memorization? A short tale about a long tail. In: Proceedings of the Annual ACM SIGACT Symposium on Theory of Computing, pp. 954–959 (2020)
2020
Earlier work this paper cites.
Lewis, P., Perez, E., Piktus, A., Petroni, F., Karpukhin, V., Goyal, N., Küttler, H., Lewis, M., Yih, W.-t., Rocktäschel, T., et al
2020
Earlier work this paper cites.
Lobry, S., Marcos, D., Murray, J., Tuia, D.: RSVQA: Visual question answering for remote sensing data. IEEE Transactions on Geoscience and Remote Sensing 58
2020
Earlier work this paper cites.
Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., et al
2021
Earlier work this paper cites.
2021
Earlier work this paper cites.
Bell, B., Hersbach, H., Simmons, A., Berrisford, P., Dahlgren, P., Horányi, A., Muñoz-Sabater, J., Nicolas, J., Radu, R., Schepers, D., et al
2021
Earlier work this paper cites.
Manas, O., Lacoste, A., Giró-i-Nieto, X., Vazquez, D., Rodriguez, P.: Seasonal Contrast: Unsupervised pre-training from uncurated remote sensing data. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 9414–9423 (2021)
2021
Earlier work this paper cites.
Kashinath, K., Mustafa, M., Albert, A., Wu, J., Jiang, C., Esmaeilzadeh, S., Azizzadenesheli, K., Wang, R., Chattopadhyay, A., Singh, A., et al.: Physics-informed machine learning: Case studies for weather and climate modelling. Philosophical Transactions of the Royal Society A 379
2021
Earlier work this paper cites.
Ayush, K., Uzkent, B., Meng, C., Tanmay, K., Burke, M., Lobell, D., Ermon, S.: Geography-aware self-supervised learning. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10181–10190 (2021)
2021
Earlier work this paper cites.
Weyn, J.A., Durran, D.R., Caruana, R., Cresswell-Clay, N.: Sub-seasonal forecasting with a large ensemble of deep-learning weather prediction models. Journal of Advances in Modeling Earth Systems 13
2021
Earlier work this paper cites.
2021
Earlier work this paper cites.
Karniadakis, G.E., Kevrekidis, I.G., Lu, L., Perdikaris, P., Wang, S., Yang, L.: Physics-informed machine learning. Nature Reviews Physics 3
2021
Earlier work this paper cites.
Yeh, C., Meng, C., Wang, S., Driscoll, A., Rozi, E., Liu, P., Lee, J.J., Burke, M., Lobell, D.B., Ermon, S.: SustainBench: Benchmarks for monitoring the sustainable development goals with machine learning. In: Proceedings of the Neural Information Processing Systems Track on Datasets and Benchmarks (2021)
2021
Earlier work this paper cites.
Lobry, S., Demir, B., Tuia, D.: RSVQA Meets BigEarthNet: A new, large-scale, visual question answering dataset for remote sensing. In: 2021 IEEE International Geoscience and Remote Sensing Symposium, pp. 1218–1221 (2021)
2021
Earlier work this paper cites.
Yuan, Z., Zhang, W., Fu, K., Li, X., Deng, C., Wang, H., Sun, X.: Exploring a fine-grained multiscale method for cross-modal remote sensing image retrieval. IEEE Transactions on Geoscience and Remote Sensing 60
2021
Earlier work this paper cites.
Rahnemoonfar, M., Chowdhury, T., Sarkar, A., Varshney, D., Yari, M., Murphy, R.R.: FloodNet: A high resolution aerial imagery dataset for post flood scene understanding. IEEE Access 9
2021
Earlier work this paper cites.
Wang, Y., Albrecht, C.M., Zhu, X.X.: Self-supervised vision transformers for joint SAR-optical representation learning. In: IEEE International Geoscience and Remote Sensing Symposium, pp. 139–142 (2022)
2022
Earlier work this paper cites.
2022
Cited alongside, same era.
Wulder, M.A., Roy, D.P., Radeloff, V.C., Loveland, T.R., Anderson, M.C., Johnson, D.M., Healey, S., Zhu, Z., Scambos, T.A., Pahlevan, N., et al
2022
Cited alongside, same era.
Dowell, D.C., Alexander, C.R., James, E.P., Weygandt, S.S., Benjamin, S.G., Manikin, G.S., Blake, B.T., Brown, J.M., Olson, J.B., Hu, M., et al
2022
Cited alongside, same era.
Toker, A., Kondmann, L., Weber, M., Eisenberger, M., Camero, A., Hu, J., Hoderlein, A.P., Şenaras, Ç., Davis, T., Cremers, D., et al
2022
Cited alongside, same era.
Wang, Y., Albrecht, C.M., Braham, N.A.A., Mou, L., Zhu, X.X.: Self-supervised learning in remote sensing: A review. IEEE Geoscience and Remote Sensing Magazine 10
2023
Later among the works it cites.
Bi, K., Xie, L., Zhang, H., Chen, X., Gu, X., Tian, Q.: Accurate medium-range global weather forecasting with 3D neural networks. Nature 619
2023
Later among the works it cites.
Lam, R., Sanchez-Gonzalez, A., Willson, M., Wirnsberger, P., Fortunato, M., Alet, F., Ravuri, S., Ewalds, T., Eaton-Rosen, Z., Hu, W., et al
2023
Later among the works it cites.
2023
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2022
Cited alongside, same era.
Cong, Y., Khanna, S., Meng, C., Liu, P., Rozi, E., He, Y., Burke, M., Lobell, D., Ermon, S.: SatMAE: Pre-training transformers for temporal and multi-spectral satellite imagery. In: Advances in Neural Information Processing Systems, vol. 35, pp. 197–211 (2022)
2022
Cited alongside, same era.
2022
Cited alongside, same era.
2022
Cited alongside, same era.
2022
Cited alongside, same era.
Watson-Parris, D., Rao, Y., Olivié, D., Seland, ø., Nowack, P., Camps-Valls, G., Stier, P., Bouabid, S., Dewey, M., Fons, E., Gonzalez, J., Harder, P., Jeggle, K., Lenhardt, J., Manshausen, P., Novitasari, M., Ricard, L., Roesch, C.: ClimateBench v1.0: A benchmark for data-driven climate projections. Journal of Advances in Modeling Earth Systems 14
2022
Cited alongside, same era.
Kikaki, K., Kakogeorgiou, I., Mikeli, P., Raitsos, D.E., Karantzalos, K.: MARIDA: A benchmark for marine debris detection from Sentinel-2 remote sensing data. PLOS ONE 17
2022
Cited alongside, same era.
Gourmelon, N., Seehaus, T., Braun, M., Maier, A., Christlein, V.: Calving fronts and where to find them: a benchmark dataset and methodology for automatic glacier calving front extraction from synthetic aperture radar imagery. Earth System Science Data 14
2022
Cited alongside, same era.
Mendieta, M., Han, B., Shi, X., Zhu, Y., Chen, C.: Towards geospatial foundation models via continual pretraining. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 16806–16816 (2023)
2023
Later among the works it cites.
Paaß, G., Giesselbach, S.: Knowledge acquired by foundation models. In: Foundation Models for Natural Language Processing: Pre-trained Language Models Integrating Media, pp. 161–185 (2023)
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
Hu, J., Liu, R., Hong, D., Camero, A., Yao, J., Schneider, M., Kurz, F., Segl, K., Zhu, X.X.: MDAS: A new multimodal benchmark dataset for remote sensing. Earth System Science Data 15
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
Chen, R., Liu, Y., Kong, L., Chen, N., Zhu, X., Ma, Y., Liu, T., Wang, W.: Towards label-free scene understanding by vision foundation models. In: Advances in Neural Information Processing Systems, vol. 36, pp. 75896–75910 (2023)
2023
Later among the works it cites.
Li, J., Li, D., Savarese, S., Hoi, S.: BLIP-2: Bootstrapping language-image pre-training with frozen image encoders and large language models. In: International Conference on Machine Learning, pp. 19730–19742 (2023)
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
Zhan, Y., Xiong, Z., Yuan, Y.: RSVG: Exploring data and models for visual grounding on remote sensing data. IEEE Transactions on Geoscience and Remote Sensing 61
2023
Later among the works it cites.
Azavea/Element 84, Robert Cheetham: Raster Vision: An open source library and framework for deep learning on satellite and aerial imagery (2017-2023). https://doi.org/10.5281/zenodo.8018177
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
2023
Later among the works it cites.
Stewart, A., Lehmann, N., Corley, I., Wang, Y., Chang, Y.-C., Ait Ali Braham, N.A., Sehgal, S., Robinson, C., Banerjee, A.: SSL4EO-L: Datasets and foundation models for Landsat imagery. In: Advances in Neural Information Processing Systems, vol. 36 (2024)
2024
Closest in time.
2024
Closest in time.
Fuller, A., Millard, K., Green, J.: CROMA: Remote sensing representations with contrastive radar-optical masked autoencoders. In: Advances in Neural Information Processing Systems, vol. 36 (2024)
2024
Closest in time.
2024
Closest in time.
2024
Closest in time.
2024
Closest in time.
2024
Closest in time.
2024
Closest in time.
2024
Closest in time.
Liu, H., Li, C., Wu, Q., Lee, Y.J.: Visual instruction tuning. In: Advances in Neural Information Processing Systems, vol. 36 (2024)
2024
Closest in time.
Lacoste, A., Lehmann, N., Rodriguez, P., Sherwin, E., Kerner, H., Lütjens, B., Irvin, J., Dao, D., Alemohammad, H., Drouin, A., et al
2024
Closest in time.
2024
Closest in time.
Nguyen, T., Jewik, J., Bansal, H., Sharma, P., Grover, A.: ClimateLearn: Benchmarking machine learning for weather and climate modeling. In: Advances in Neural Information Processing Systems, vol. 36 (2024)
2024
Closest in time.
2024
Closest in time.
Truhn, D., Eckardt, J.-N., Ferber, D., Kather, J.N.: Large language models and multimodal foundation models for precision oncology. NPJ Precision Oncology 8
2024
Closest in time.
Srivastava, S., Sharma, G.: OmniVec: Learning robust representations with cross modal sharing. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp. 1236–1248 (2024)
2024
Closest in time.
2024
Closest in time.