Back to search

University of Minnesota

Reading minds with fMRI and machine learning.

Abstract

dc:description.abstract

A major challenge in brain decoding is to reconstruct internally generated visual representations—mental images—from human brain activity. While the Natural Scenes Dataset (NSD) has enabled unprecedented improvements in reconstructing \textit{seen} images from fMRI signals, methods training on it have primarily been limited to decoding only externally presented stimuli. In an analysis of the new NSD-Imagery dataset, I demonstrate that while some modern NSD-trained vision decoders can generalize quite well in reconstructing mental images, some fail, and that state-of-the-art (SOTA) performance on seen image reconstruction is no guarantee of good performance on mental image reconstruction. Motivated by these findings, I developed MIRAGE, a novel method explicitly designed to train on vision datasets and cross-decode mental images from brain activity. MIRAGE employs a simple and robust ridge regression backbone, maps to multi-modal text and image features, and adopts the Stable Cascade diffusion model which accepts multi-modal conditioning and small image embeddings as input. Evaluations on the NSD-Imagery benchmark—supported by human ratings and feature-based metrics—establish MIRAGE as the SOTA method for producing mental image reconstructions. This result indicates that--given the right architecture--existing large-scale datasets using external stimuli are viable training data for decoding mental images, yielding new computationally-driven insights into how mental images are represented in the brain, and offering concrete paths forward for more accurate and flexible mental imagery decoding.

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Kneeland, Reese

Subjects

dc:subject × 6

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Citation
Kneeland, Reese. (2025). Reading minds with fMRI and machine learning.. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/275902.

Chain of custody

source
Harvested from
University of Minnesota
Base URL
conservancy.umn.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Kneeland, Reese. Reading minds with fMRI and machine learning.. 2025. https://hdl.handle.net/11299/275902