{"id":{"repo_id":"usf","oai_identifier":"oai:digitalcommons.usf.edu:etd-12704"},"canonical_url":"https://search.ndltd.org/etd/usf/oai:digitalcommons.usf.edu:etd-12704","repository":{"repo_id":"usf","name":"University of South Florida","base_url":"https://digitalcommons.usf.edu/do/oai/"},"display":{"title":"Geospatial Understanding of Foundation Models: Self-Supervision, Robustness, and Resource-Constrained Learning","abstract":"Research on large-scale geospatial understanding from satellite imagery remains relativelyunderexplored. Much of the field still relies on narrow, task-specific pipelines, and there is lim- ited work on developing true foundation models or on systematically evaluating how well these models generalize under domain shift, geographic variation, and real-world scene diversity. This dissertation advances foundation-model pretraining and evaluation for remote sensing along three complementary axes. First, we develop self-supervised multispectral pretrained models for satellite image classification by adapting BYOL, BarlowTwins, DINO, MoCo, and Simsiam to multispectral inputs, addressing the limited amount of curated satellite datasets relative to ImageNet. Pretraining on Eurosat and BigEarthNet yields strong transfer for classification across datasets, providing multispectral pretrained models for BigEarthNet that have yet to be fully explored in prior work, and demonstrating competitive performance despite using a fraction of the image samples typically used in ImageNet-scale training. Second, to study robustness and generalization of geospatial foundation models beyond narrow demonstrations, we benchmark eight state-of-the-art ViT-based foundation models, spanning self-supervised MAE variants (SatMAE, Scale-MAE, Cross-Scale MAE), the Geospatial Foundation Model, and supervised Multi-Task Pretraining (MTP). Models pretrained on fMoW, SAMRS, Million-AID, or GeoPile are evaluated via end-to-end fine-tuning on four down- stream tasks—classification, segmentation, oriented object detection, and change detection—across DOTA-v2.0, BigEarthNet, and xDB. Results show that performance is strongly task dependent: foundation models match or exceed supervised baselines for classification and segmentation, yet struggle with change detection and oriented object detection, and cross-dataset performance is hampered by differences in imagery from different satellites. Across settings, pretraining data quality, particularly spatial resolution and scene diversity, drives downstream success more than sheer dataset size, and scaling from ViT-Base to ViT-Large yields less than a 1% improvement. Finally, to enable resource-constrained learning, we introduce Hierarchical Attention Dis- tillation (HAD), a pretraining paradigm that transfers spatial and semantic representations from a large teacher foundation model to a compact student via multi-level attention across feature maps at multiple spatial scales, improving feature-transfer fidelity and accelerating convergence. Unlike conventional supervised knowledge distillation that relies on the teacher’s labeled pretraining data, the student is pretrained on a separate unlabeled dataset (SSL4EO), distinct from the MillionAID dataset used for the teacher, and then fine-tuned on classification and segmentation. The distilled compact model achieves performance closely aligned with current state-of-the-art satellite founda- tion models while substantially improving computational efficiency and fine-tuning time, supporting practical deployment where parameters and latency are constrained","abstract_html":"Research on large-scale geospatial understanding from satellite imagery remains relativelyunderexplored. Much of the field still relies on narrow, task-specific pipelines, and there is lim- ited work on developing true foundation models or on systematically evaluating how well these models generalize under domain shift, geographic variation, and real-world scene diversity. This dissertation advances foundation-model pretraining and evaluation for remote sensing along three complementary axes. First, we develop self-supervised multispectral pretrained models for satellite image classification by adapting BYOL, BarlowTwins, DINO, MoCo, and Simsiam to multispectral inputs, addressing the limited amount of curated satellite datasets relative to ImageNet. Pretraining on Eurosat and BigEarthNet yields strong transfer for classification across datasets, providing multispectral pretrained models for BigEarthNet that have yet to be fully explored in prior work, and demonstrating competitive performance despite using a fraction of the image samples typically used in ImageNet-scale training. Second, to study robustness and generalization of geospatial foundation models beyond narrow demonstrations, we benchmark eight state-of-the-art ViT-based foundation models, spanning self-supervised MAE variants (SatMAE, Scale-MAE, Cross-Scale MAE), the Geospatial Foundation Model, and supervised Multi-Task Pretraining (MTP). Models pretrained on fMoW, SAMRS, Million-AID, or GeoPile are evaluated via end-to-end fine-tuning on four down- stream tasks—classification, segmentation, oriented object detection, and change detection—across DOTA-v2.0, BigEarthNet, and xDB. Results show that performance is strongly task dependent: foundation models match or exceed supervised baselines for classification and segmentation, yet struggle with change detection and oriented object detection, and cross-dataset performance is hampered by differences in imagery from different satellites. Across settings, pretraining data quality, particularly spatial resolution and scene diversity, drives downstream success more than sheer dataset size, and scaling from ViT-Base to ViT-Large yields less than a 1% improvement. Finally, to enable resource-constrained learning, we introduce Hierarchical Attention Dis- tillation (HAD), a pretraining paradigm that transfers spatial and semantic representations from a large teacher foundation model to a compact student via multi-level attention across feature maps at multiple spatial scales, improving feature-transfer fidelity and accelerating convergence. Unlike conventional supervised knowledge distillation that relies on the teacher’s labeled pretraining data, the student is pretrained on a separate unlabeled dataset (SSL4EO), distinct from the MillionAID dataset used for the teacher, and then fine-tuned on classification and segmentation. The distilled compact model achieves performance closely aligned with current state-of-the-art satellite founda- tion models while substantially improving computational efficiency and fine-tuning time, supporting practical deployment where parameters and latency are constrained","abstract_has_math":false,"creators":["Rotich, Gilbert Kibet"],"institution":"University of South Florida","degree_name":"Doctor of Philosophy (Ph.D.)","degree_level":"Dissertation","degree_discipline":"Computer Science and Engineering","degree_department":null,"school":null,"contributors":["Sudeep Sarkar, Ph.D.","Lawrence Hall, Ph.D.","Dmitry Goldgof, Ph.D.","Susana Lai-Yuen, Ph.D.","Joni Downs Firat, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2026,"date_issued":"2026-03-26T07:00:00Z","date_published":"2026-03-26T07:00:00Z","updated_at":"2026-11-19T08:52:02Z","subjects":["Satellite Imagery","Remote Sensing","Deep Learning","Self-Supervised Learning","Foundation Models","Computer Sciences"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.usf.edu/etd/11401","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.usf.edu/etd/11401","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.usf.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.usf.edu%3Aetd-12704","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Sudeep Sarkar, Ph.D.","Lawrence Hall, Ph.D.","Dmitry Goldgof, Ph.D.","Susana Lai-Yuen, Ph.D.","Joni Downs Firat, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Rotich, Gilbert Kibet"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2026-03-26T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science and Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation","Ph.D."]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy (Ph.D.)"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of South Florida"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Satellite Imagery","Remote Sensing","Deep Learning","Self-Supervised Learning","Foundation Models","Computer Sciences"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.usf.edu/etd/11401"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["Research on large-scale geospatial understanding from satellite imagery remains relativelyunderexplored. Much of the field still relies on narrow, task-specific pipelines, and there is lim- ited work on developing true foundation models or on systematically evaluating how well these models generalize under domain shift, geographic variation, and real-world scene diversity. This dissertation advances foundation-model pretraining and evaluation for remote sensing along three complementary axes. First, we develop self-supervised multispectral pretrained models for satellite image classification by adapting BYOL, BarlowTwins, DINO, MoCo, and Simsiam to multispectral inputs, addressing the limited amount of curated satellite datasets relative to ImageNet. Pretraining on Eurosat and BigEarthNet yields strong transfer for classification across datasets, providing multispectral pretrained models for BigEarthNet that have yet to be fully explored in prior work, and demonstrating competitive performance despite using a fraction of the image samples typically used in ImageNet-scale training. Second, to study robustness and generalization of geospatial foundation models beyond narrow demonstrations, we benchmark eight state-of-the-art ViT-based foundation models, spanning self-supervised MAE variants (SatMAE, Scale-MAE, Cross-Scale MAE), the Geospatial Foundation Model, and supervised Multi-Task Pretraining (MTP). Models pretrained on fMoW, SAMRS, Million-AID, or GeoPile are evaluated via end-to-end fine-tuning on four down- stream tasks—classification, segmentation, oriented object detection, and change detection—across DOTA-v2.0, BigEarthNet, and xDB. Results show that performance is strongly task dependent: foundation models match or exceed supervised baselines for classification and segmentation, yet struggle with change detection and oriented object detection, and cross-dataset performance is hampered by differences in imagery from different satellites. Across settings, pretraining data quality, particularly spatial resolution and scene diversity, drives downstream success more than sheer dataset size, and scaling from ViT-Base to ViT-Large yields less than a 1% improvement. Finally, to enable resource-constrained learning, we introduce Hierarchical Attention Dis- tillation (HAD), a pretraining paradigm that transfers spatial and semantic representations from a large teacher foundation model to a compact student via multi-level attention across feature maps at multiple spatial scales, improving feature-transfer fidelity and accelerating convergence. Unlike conventional supervised knowledge distillation that relies on the teacher’s labeled pretraining data, the student is pretrained on a separate unlabeled dataset (SSL4EO), distinct from the MillionAID dataset used for the teacher, and then fine-tuned on classification and segmentation. The distilled compact model achieves performance closely aligned with current state-of-the-art satellite founda- tion models while substantially improving computational efficiency and fine-tuning time, supporting practical deployment where parameters and latency are constrained"]},{"key":"dc:title","label":"Title","values":["Geospatial Understanding of Foundation Models: Self-Supervision, Robustness, and Resource-Constrained Learning"]}]}],"canonical_facts":{"dc:contributor":["Sudeep Sarkar, Ph.D.","Lawrence Hall, Ph.D.","Dmitry Goldgof, Ph.D.","Susana Lai-Yuen, Ph.D.","Joni Downs Firat, Ph.D."],"dc:creator":["Rotich, Gilbert Kibet"],"dc:date":["2026-03-26T07:00:00Z"],"dc:description":["Research on large-scale geospatial understanding from satellite imagery remains relativelyunderexplored. Much of the field still relies on narrow, task-specific pipelines, and there is lim- ited work on developing true foundation models or on systematically evaluating how well these models generalize under domain shift, geographic variation, and real-world scene diversity. This dissertation advances foundation-model pretraining and evaluation for remote sensing along three complementary axes. First, we develop self-supervised multispectral pretrained models for satellite image classification by adapting BYOL, BarlowTwins, DINO, MoCo, and Simsiam to multispectral inputs, addressing the limited amount of curated satellite datasets relative to ImageNet. Pretraining on Eurosat and BigEarthNet yields strong transfer for classification across datasets, providing multispectral pretrained models for BigEarthNet that have yet to be fully explored in prior work, and demonstrating competitive performance despite using a fraction of the image samples typically used in ImageNet-scale training. Second, to study robustness and generalization of geospatial foundation models beyond narrow demonstrations, we benchmark eight state-of-the-art ViT-based foundation models, spanning self-supervised MAE variants (SatMAE, Scale-MAE, Cross-Scale MAE), the Geospatial Foundation Model, and supervised Multi-Task Pretraining (MTP). Models pretrained on fMoW, SAMRS, Million-AID, or GeoPile are evaluated via end-to-end fine-tuning on four down- stream tasks—classification, segmentation, oriented object detection, and change detection—across DOTA-v2.0, BigEarthNet, and xDB. Results show that performance is strongly task dependent: foundation models match or exceed supervised baselines for classification and segmentation, yet struggle with change detection and oriented object detection, and cross-dataset performance is hampered by differences in imagery from different satellites. Across settings, pretraining data quality, particularly spatial resolution and scene diversity, drives downstream success more than sheer dataset size, and scaling from ViT-Base to ViT-Large yields less than a 1% improvement. Finally, to enable resource-constrained learning, we introduce Hierarchical Attention Dis- tillation (HAD), a pretraining paradigm that transfers spatial and semantic representations from a large teacher foundation model to a compact student via multi-level attention across feature maps at multiple spatial scales, improving feature-transfer fidelity and accelerating convergence. Unlike conventional supervised knowledge distillation that relies on the teacher’s labeled pretraining data, the student is pretrained on a separate unlabeled dataset (SSL4EO), distinct from the MillionAID dataset used for the teacher, and then fine-tuned on classification and segmentation. The distilled compact model achieves performance closely aligned with current state-of-the-art satellite founda- tion models while substantially improving computational efficiency and fine-tuning time, supporting practical deployment where parameters and latency are constrained"],"dc:identifier":["https://digitalcommons.usf.edu/etd/11401"],"dc:subject":["Satellite Imagery","Remote Sensing","Deep Learning","Self-Supervised Learning","Foundation Models","Computer Sciences"],"dc:title":["Geospatial Understanding of Foundation Models: Self-Supervision, Robustness, and Resource-Constrained Learning"],"thesis:degree_discipline":["Computer Science and Engineering"],"thesis:degree_level":["Dissertation","Ph.D."],"thesis:degree_name":["Doctor of Philosophy (Ph.D.)"],"thesis:institution_name":["University of South Florida"]},"updated_at":"2026-11-19T08:52:02Z"}