Back to search

University of South Florida

Geospatial Understanding of Foundation Models: Self-Supervision, Robustness, and Resource-Constrained Learning

Abstract

dc:description

Research on large-scale geospatial understanding from satellite imagery remains relativelyunderexplored. Much of the field still relies on narrow, task-specific pipelines, and there is lim- ited work on developing true foundation models or on systematically evaluating how well these models generalize under domain shift, geographic variation, and real-world scene diversity. This dissertation advances foundation-model pretraining and evaluation for remote sensing along three complementary axes. First, we develop self-supervised multispectral pretrained models for satellite image classification by adapting BYOL, BarlowTwins, DINO, MoCo, and Simsiam to multispectral inputs, addressing the limited amount of curated satellite datasets relative to ImageNet. Pretraining on Eurosat and BigEarthNet yields strong transfer for classification across datasets, providing multispectral pretrained models for BigEarthNet that have yet to be fully explored in prior work, and demonstrating competitive performance despite using a fraction of the image samples typically used in ImageNet-scale training. Second, to study robustness and generalization of geospatial foundation models beyond narrow demonstrations, we benchmark eight state-of-the-art ViT-based foundation models, spanning self-supervised MAE variants (SatMAE, Scale-MAE, Cross-Scale MAE), the Geospatial Foundation Model, and supervised Multi-Task Pretraining (MTP). Models pretrained on fMoW, SAMRS, Million-AID, or GeoPile are evaluated via end-to-end fine-tuning on four down- stream tasks—classification, segmentation, oriented object detection, and change detection—across DOTA-v2.0, BigEarthNet, and xDB. Results show that performance is strongly task dependent: foundation models match or exceed supervised baselines for classification and segmentation, yet struggle with change detection and oriented object detection, and cross-dataset performance is hampered by differences in imagery from different satellites. Across settings, pretraining data quality, particularly spatial resolution and scene diversity, drives downstream success more than sheer dataset size, and scaling from ViT-Base to ViT-Large yields less than a 1% improvement. Finally, to enable resource-constrained learning, we introduce Hierarchical Attention Dis- tillation (HAD), a pretraining paradigm that transfers spatial and semantic representations from a large teacher foundation model to a compact student via multi-level attention across feature maps at multiple spatial scales, improving feature-transfer fidelity and accelerating convergence. Unlike conventional supervised knowledge distillation that relies on the teacher’s labeled pretraining data, the student is pretrained on a separate unlabeled dataset (SSL4EO), distinct from the MillionAID dataset used for the teacher, and then fine-tuned on classification and segmentation. The distilled compact model achieves performance closely aligned with current state-of-the-art satellite founda- tion models while substantially improving computational efficiency and fine-tuning time, supporting practical deployment where parameters and latency are constrained

Degree

thesis:*
Name thesis:degree_name
Doctor of Philosophy (Ph.D.)
Level thesis:degree_level
Dissertation
Discipline thesis:degree_discipline
Computer Science and Engineering
Grantor
University of South Florida
Year dc:date
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Rotich, Gilbert Kibet
Contributors dc:contributor
  • Sudeep Sarkar, Ph.D.
  • Lawrence Hall, Ph.D.
  • Dmitry Goldgof, Ph.D.
  • Susana Lai-Yuen, Ph.D.
  • Joni Downs Firat, Ph.D.

Subjects

dc:subject × 6

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.usf.edu/etd/11401

Chain of custody

source
Harvested from
University of South Florida
Base URL
digitalcommons.usf.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Rotich, Gilbert Kibet. Geospatial Understanding of Foundation Models: Self-Supervision, Robustness, and Resource-Constrained Learning. Dissertation thesis, University of South Florida, 2026. https://digitalcommons.usf.edu/etd/11401