Back to search

Georgia Institute of Technology

Self-Supervised Multimodal Representation Learning for Neuroimaging

Abstract

dc:description.abstract

In the pursuit of developing foundation models to understand neuropsychiatric disorders, we have to build computationally and data-efficient multimodal models while ensuring interpretability, robustness, and fairness. We have taken two significant steps toward this goal. First, we introduce a fast, accurate, and multimodal architecture for segmenting brain tissues and atlas regions that is scalable to large morphometry studies by training in a semi-supervised manner using imperfect labeling. Our second breakthrough leverages mutual information to learn self-supervised representations from structural and functional brain imaging data. Our models exhibit promising results in predicting neuropsychiatric disorders, identifying disorder-relevant brain regions, and multimodal links. We conclude this dissertation by highlighting potential advancements in multimodal self-supervision for neuroimaging.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Electrical and Computer Engineering
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2023

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Fedorov, Aleksandr
Advisors dc:contributor.advisor
  • Calhoun, Vince D.
  • Plis, Sergey
Committee members dc:contributor.committeemember
  • Rozell, Christopher
  • Dyer, Eva
  • Wu, Anqi
  • Keilholz, Shella

Subjects

dc:subject × 6

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/76757

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Fedorov, Aleksandr. Self-Supervised Multimodal Representation Learning for Neuroimaging. Doctoral thesis, Georgia Institute of Technology, 2023. https://hdl.handle.net/1853/76757