{"id":{"repo_id":"bu","oai_identifier":"oai:open.bu.edu:2144/49902"},"canonical_url":"https://search.ndltd.org/etd/bu/oai:open.bu.edu:2144/49902","repository":{"repo_id":"bu","name":"Boston University","base_url":"https://open.bu.edu/oai/request"},"display":{"title":"Flexible multimodal learning for whole slide image analysis","abstract":"Whole slide imaging (WSI) has revolutionized digital pathology, enabling the digitization of entire tissue samples on glass slides into high-resolution images, providing a detailed view of tissue morphology essential for analysis and interpretation. However, practical challenges arise due to the varying availability and cost of different slide staining techniques. Hematoxylin and Eosin (H&E) staining is commonly performed and cost-effective, but it offers limited information compared to more expensive and less frequently conducted immunohistochemical (IHC) staining, which provides specific molecular insights critical for diagnosing conditions like Alzheimer’s disease (AD) and chronic traumatic encephalopathy (CTE). Addressing the need for a comprehensive analysis in the absence of complete modality sets, this research introduces ”MultiStainKD ,” a novel framework designed to handle multimodal WSI data effectively, even when certain modalities, such as IHC, are missing. MultiStainKD employs a combination of computational architectural design and training strategies, optimizing the use of available data to enhance diagnostic accuracy. It utilizes a blend of convolutional and transformer-based components to capture the nuanced interplay of local and global tissue features, thus ensuring robust performance without the necessity for costly feature generation processes traditionally used to compensate for missing modalities. Our extensive testing shows MultiStainKD’s superior capability in managing missing modalities and setting new benchmarks in AD and CTE prediction accuracy. By leveraging the inherent complementary information within accessible stains and slides, MultiStainKD demonstrates its practical value and effectiveness, aligning with the goal of maintaining diagnostic quality despite the unavailability of comprehensive staining modalities. This advancement signifies an important step forward in multimodal learning for digital pathology, potentially enhancing diagnostic accuracy and supporting patient care when full modality data is not available.","abstract_html":"Whole slide imaging (WSI) has revolutionized digital pathology, enabling the digitization of entire tissue samples on glass slides into high-resolution images, providing a detailed view of tissue morphology essential for analysis and interpretation. However, practical challenges arise due to the varying availability and cost of different slide staining techniques. Hematoxylin and Eosin (H&amp;E) staining is commonly performed and cost-effective, but it offers limited information compared to more expensive and less frequently conducted immunohistochemical (IHC) staining, which provides specific molecular insights critical for diagnosing conditions like Alzheimer’s disease (AD) and chronic traumatic encephalopathy (CTE). Addressing the need for a comprehensive analysis in the absence of complete modality sets, this research introduces ”MultiStainKD ,” a novel framework designed to handle multimodal WSI data effectively, even when certain modalities, such as IHC, are missing. MultiStainKD employs a combination of computational architectural design and training strategies, optimizing the use of available data to enhance diagnostic accuracy. It utilizes a blend of convolutional and transformer-based components to capture the nuanced interplay of local and global tissue features, thus ensuring robust performance without the necessity for costly feature generation processes traditionally used to compensate for missing modalities. Our extensive testing shows MultiStainKD’s superior capability in managing missing modalities and setting new benchmarks in AD and CTE prediction accuracy. By leveraging the inherent complementary information within accessible stains and slides, MultiStainKD demonstrates its practical value and effectiveness, aligning with the goal of maintaining diagnostic quality despite the unavailability of comprehensive staining modalities. This advancement signifies an important step forward in multimodal learning for digital pathology, potentially enhancing diagnostic accuracy and supporting patient care when full modality data is not available.","abstract_has_math":false,"creators":["Sharma, Harsh"],"institution":"Boston University","degree_name":"Master of Science","degree_level":"masters","degree_discipline":"Computer Science","degree_department":null,"school":null,"contributors":[],"advisors":["Kolachalama, Vijaya B."],"committee_chairs":[],"committee_members":[],"year":2024,"date_issued":"2024","date_published":"2024","updated_at":"2026-11-18T19:49:06Z","subjects":["Artificial intelligence","Computer vision","Digital pathology","Multimodal","Neurology","Transformers","Whole slide imaging"],"languages":["en_US"],"rights":["Attribution 4.0 International"],"rights_urls":["http://creativecommons.org/licenses/by/4.0/"],"identifier_entries":[],"person_identifier_entries":[{"key":"dc:identifier.orcid","label":"ORCID","values":["0000-0003-4711-2192"],"render_values":[{"text":"0000-0003-4711-2192","href":"https://orcid.org/0000-0003-4711-2192","code":true}]}]},"links":{"outbound_url":"https://hdl.handle.net/2144/49902","outbound_label":"Handle","outbound_source":"dc:identifier.uri","record_url":"https://hdl.handle.net/2144/49902","record_label":"Repository record","record_kind":"handle","record_source":"dc:identifier.uri","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://open.bu.edu/oai/request?verb=GetRecord&metadataPrefix=dim&identifier=oai%3Aopen.bu.edu%3A2144%2F49902","prefix":"dim"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor.advisor","label":"Advisor","values":["Kolachalama, Vijaya B."]},{"key":"dc:creator","label":"Author","values":["Sharma, Harsh"]},{"key":"dc:identifier.orcid","label":"ORCID","values":["0000-0003-4711-2192"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.accessioned","label":"Dc Date Accessioned","values":["2025-03-06T16:17:39Z"]},{"key":"dc:date.available","label":"Dc Date Available","values":["2025-03-06T16:17:39Z"]},{"key":"dc:date.issued","label":"Date","values":["2024"]},{"key":"dc:date.updated","label":"Dc Date Updated","values":["2025-03-06T02:01:10Z"]},{"key":"dc:type","label":"Dc Type","values":["Thesis/Dissertation"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["masters"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Master of Science"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["Boston University"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Artificial intelligence","Computer vision","Digital pathology","Multimodal","Neurology","Transformers","Whole slide imaging"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:language.iso","label":"Language (ISO)","values":["en_US"]},{"key":"dc:rights","label":"Dc Rights","values":["Attribution 4.0 International"]},{"key":"dc:rights.uri","label":"Rights URI","values":["http://creativecommons.org/licenses/by/4.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier.uri","label":"Identifier URI","values":["https://hdl.handle.net/2144/49902"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["2024"]},{"key":"dc:description.abstract","label":"Abstract","values":["Whole slide imaging (WSI) has revolutionized digital pathology, enabling the digitization of entire tissue samples on glass slides into high-resolution images, providing a detailed view of tissue morphology essential for analysis and interpretation. However, practical challenges arise due to the varying availability and cost of different slide staining techniques. Hematoxylin and Eosin (H&E) staining is commonly performed and cost-effective, but it offers limited information compared to more expensive and less frequently conducted immunohistochemical (IHC) staining, which provides specific molecular insights critical for diagnosing conditions like Alzheimer’s disease (AD) and chronic traumatic encephalopathy (CTE). Addressing the need for a comprehensive analysis in the absence of complete modality sets, this research introduces ”MultiStainKD ,” a novel framework designed to handle multimodal WSI data effectively, even when certain modalities, such as IHC, are missing. MultiStainKD employs a combination of computational architectural design and training strategies, optimizing the use of available data to enhance diagnostic accuracy. It utilizes a blend of convolutional and transformer-based components to capture the nuanced interplay of local and global tissue features, thus ensuring robust performance without the necessity for costly feature generation processes traditionally used to compensate for missing modalities. Our extensive testing shows MultiStainKD’s superior capability in managing missing modalities and setting new benchmarks in AD and CTE prediction accuracy. By leveraging the inherent complementary information within accessible stains and slides, MultiStainKD demonstrates its practical value and effectiveness, aligning with the goal of maintaining diagnostic quality despite the unavailability of comprehensive staining modalities. This advancement signifies an important step forward in multimodal learning for digital pathology, potentially enhancing diagnostic accuracy and supporting patient care when full modality data is not available."]},{"key":"dc:title","label":"Title","values":["Flexible multimodal learning for whole slide image analysis"]}]}],"canonical_facts":{"dc:contributor.advisor":["Kolachalama, Vijaya B."],"dc:creator":["Sharma, Harsh"],"dc:date.accessioned":["2025-03-06T16:17:39Z"],"dc:date.available":["2025-03-06T16:17:39Z"],"dc:date.issued":["2024"],"dc:date.updated":["2025-03-06T02:01:10Z"],"dc:description":["2024"],"dc:description.abstract":["Whole slide imaging (WSI) has revolutionized digital pathology, enabling the digitization of entire tissue samples on glass slides into high-resolution images, providing a detailed view of tissue morphology essential for analysis and interpretation. However, practical challenges arise due to the varying availability and cost of different slide staining techniques. Hematoxylin and Eosin (H&E) staining is commonly performed and cost-effective, but it offers limited information compared to more expensive and less frequently conducted immunohistochemical (IHC) staining, which provides specific molecular insights critical for diagnosing conditions like Alzheimer’s disease (AD) and chronic traumatic encephalopathy (CTE). Addressing the need for a comprehensive analysis in the absence of complete modality sets, this research introduces ”MultiStainKD ,” a novel framework designed to handle multimodal WSI data effectively, even when certain modalities, such as IHC, are missing. MultiStainKD employs a combination of computational architectural design and training strategies, optimizing the use of available data to enhance diagnostic accuracy. It utilizes a blend of convolutional and transformer-based components to capture the nuanced interplay of local and global tissue features, thus ensuring robust performance without the necessity for costly feature generation processes traditionally used to compensate for missing modalities. Our extensive testing shows MultiStainKD’s superior capability in managing missing modalities and setting new benchmarks in AD and CTE prediction accuracy. By leveraging the inherent complementary information within accessible stains and slides, MultiStainKD demonstrates its practical value and effectiveness, aligning with the goal of maintaining diagnostic quality despite the unavailability of comprehensive staining modalities. This advancement signifies an important step forward in multimodal learning for digital pathology, potentially enhancing diagnostic accuracy and supporting patient care when full modality data is not available."],"dc:identifier.orcid":["0000-0003-4711-2192"],"dc:identifier.uri":["https://hdl.handle.net/2144/49902"],"dc:language.iso":["en_US"],"dc:rights":["Attribution 4.0 International"],"dc:rights.uri":["http://creativecommons.org/licenses/by/4.0/"],"dc:subject":["Artificial intelligence","Computer vision","Digital pathology","Multimodal","Neurology","Transformers","Whole slide imaging"],"dc:title":["Flexible multimodal learning for whole slide image analysis"],"dc:type":["Thesis/Dissertation"],"thesis:degree_discipline":["Computer Science"],"thesis:degree_level":["masters"],"thesis:degree_name":["Master of Science"],"thesis:institution_name":["Boston University"]},"updated_at":"2026-11-18T19:49:06Z"}