Georgia Institute of Technology
Self-Supervised Multimodal Representation Learning for Neuroimaging
Abstract
dc:description.abstractIn the pursuit of developing foundation models to understand neuropsychiatric disorders, we have to build computationally and data-efficient multimodal models while ensuring interpretability, robustness, and fairness. We have taken two significant steps toward this goal. First, we introduce a fast, accurate, and multimodal architecture for segmenting brain tissues and atlas regions that is scalable to large morphometry studies by training in a semi-supervised manner using imperfect labeling. Our second breakthrough leverages mutual information to learn self-supervised representations from structural and functional brain imaging data. Our models exhibit promising results in predicting neuropsychiatric disorders, identifying disorder-relevant brain regions, and multimodal links. We conclude this dissertation by highlighting potential advancements in multimodal self-supervision for neuroimaging.
Degree
thesis:*- Level thesis:degree_level
- Doctoral
- Department dc:contributor.department
- Electrical and Computer Engineering
- Grantor dc:publisher
- Georgia Institute of Technology
- Year dc:date.issued
- 2023
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Fedorov, Aleksandr
- Advisors dc:contributor.advisor
-
- Calhoun, Vince D.
- Plis, Sergey
- Committee members dc:contributor.committeemember
-
- Rozell, Christopher
- Dyer, Eva
- Wu, Anqi
- Keilholz, Shella
Subjects
dc:subject × 6Rights
- Language dc:language.iso
- en_US
Identifiers
dc:identifier.*- Handle dc:identifier.uri
- https://hdl.handle.net/1853/76757