Back to search

University of Glasgow

Scaling resolution via guided priors: from explicit multimodal fusion to inference-time adaptation of generative foundation models

Abstract

dc:description.abstract

Achieving high spatial resolution remains a fundamental challenge in computer vision, where results often fail to adhere to physical constraints. This thesis investigates the use of guided priors to mitigate these limitations, tracing a methodological evolution from explicit multimodal fusion in supervised settings to implicit inference-time priors within generative foundation models across 2D and 3D domains. First, we address depth sensor resolution limits through explicit guidance. We propose IGAF (Incremental Guided Attention Fusion), a deep learning architecture that utilizes high-resolution RGB images to iteratively upsample depth maps. By selectively attending to cross-modal features, IGAF transfers structural guidance from the RGB domain to reconstruct fine geometric details that exceed the sensors native resolution. Shifting toward generative AI, we introduce Pixelsmith, a zero-shot framework for gigapixel image generation on a single GPU. By employing a cascading approach where lower-resolution outputs serve as explicit guidance for patch-based denoising, we leverage the foundation models learned knowledge as an implicit prior. This enables the synthesis of extreme detail while overcoming the memory constraints of standard diffusion models. Finally, we extend this paradigm to 3D with SceneHI, a framework that lifts 2D generative features into 3D space. By orchestrating a rendering / inverse rendering loop as explicit guidance to adapt implicit priors, SceneHI eliminates multi-view inconsistencies. We further integrate geometry-consistent shadows, addressing both resolution and physical plausibility constraints in complex 3D environments. Ultimately, this thesis establishes that structural guidance is an essential requirement for surpassing the physical resolution limits of sensors and foundation models across 2D and 3D domains.

Degree

thesis:*
Level dc:type.qualificationlevel
PhD
Grantor dc:publisher.institution
University of Glasgow
Year dc:date.issued
2026

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Tragakis, Athanasios

Subjects

dc:subject × 1

Rights

Language dc:language
en

Identifiers

dc:identifier.*

Chain of custody

source
Harvested from
University of Glasgow
Base URL
theses.gla.ac.uk/cgi/oai2
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Tragakis, Athanasios. Scaling resolution via guided priors: from explicit multimodal fusion to inference-time adaptation of generative foundation models. PhD thesis, University of Glasgow, 2026. https://doi.org/10.5525/gla.thesis.86161