{"id":{"repo_id":"usf","oai_identifier":"oai:digitalcommons.usf.edu:etd-12577"},"canonical_url":"https://search.ndltd.org/etd/usf/oai:digitalcommons.usf.edu:etd-12577","repository":{"repo_id":"usf","name":"University of South Florida","base_url":"https://digitalcommons.usf.edu/do/oai/"},"display":{"title":"Language Models for Oncology Clinical Text: How Model Architecture and Data Strategies Shape Tumor Phenotype Extraction and Disease Progression Detection","abstract":"The rapid growth of electronic health records (EHRs) has created new opportunities to apply machine learning to clinical data.However, a large portion of important clinical information is still stored in unstructured text, such as pathology reports, radiology reports, and longitudinal clinical notes.These documents contain key details about tumor characteristics, diagnoses, treatments, and patient outcomes.Extracting structured and useful information from this text is challenging due to complex medical language, varied document formats, and the need to combine information across multiple reports over time.This dissertation studies how language models can be designed and adapted to better extract and use oncology-specific information from clinical text. The work is organized into three tasks that increase in complexity. First, I study how to improve question answering by integrating structured clinical knowledge into generative language models. I develop a pipeline that uses encoder-based models to extract important clinical information and include it in prompts. This approach helps the generative model produce more accurate and clinically meaningful answers. Next, I extend my work to tumor phenotype extraction from pathology reports. This task is difficult because pathology reports are long and contain detailed clinical information. To address this, I evaluate different transformer architectures and study how well they handle long clinical text. Finally, I focus on longitudinal clinical reasoning by studying disease progression detection from patient timelines. This task is more complex because it requires combining information from multiple reports over time. I evaluate how well language models can identify progression events and study their performance under real-world class imbalance. Overall, this dissertation shows that language models can be improved by injecting structured clinical information into the generation process, leading to more accurate and clinically meaningful outputs.To support this, the second and third parts focus on identifying the most effective ways to extract high-quality clinical information from complex pathology reports and longitudinal patient data. The tumor phenotype extraction task determines the best model architectures for capturing detailed clinical attributes, while the progression detection task extends this by identifying key clinical events over time. These components are closely connected, as better information extraction directly strengthens the knowledge that is fed back into the generative model. Together, this work demonstrates that aligning information extraction and generation enables smaller, specialized models to achieve strong performance while remaining practical for real-world, privacy-sensitive oncology applications.","abstract_html":"The rapid growth of electronic health records (EHRs) has created new opportunities to apply machine learning to clinical data.However, a large portion of important clinical information is still stored in unstructured text, such as pathology reports, radiology reports, and longitudinal clinical notes.These documents contain key details about tumor characteristics, diagnoses, treatments, and patient outcomes.Extracting structured and useful information from this text is challenging due to complex medical language, varied document formats, and the need to combine information across multiple reports over time.This dissertation studies how language models can be designed and adapted to better extract and use oncology-specific information from clinical text. The work is organized into three tasks that increase in complexity. First, I study how to improve question answering by integrating structured clinical knowledge into generative language models. I develop a pipeline that uses encoder-based models to extract important clinical information and include it in prompts. This approach helps the generative model produce more accurate and clinically meaningful answers. Next, I extend my work to tumor phenotype extraction from pathology reports. This task is difficult because pathology reports are long and contain detailed clinical information. To address this, I evaluate different transformer architectures and study how well they handle long clinical text. Finally, I focus on longitudinal clinical reasoning by studying disease progression detection from patient timelines. This task is more complex because it requires combining information from multiple reports over time. I evaluate how well language models can identify progression events and study their performance under real-world class imbalance. Overall, this dissertation shows that language models can be improved by injecting structured clinical information into the generation process, leading to more accurate and clinically meaningful outputs.To support this, the second and third parts focus on identifying the most effective ways to extract high-quality clinical information from complex pathology reports and longitudinal patient data. The tumor phenotype extraction task determines the best model architectures for capturing detailed clinical attributes, while the progression detection task extends this by identifying key clinical events over time. These components are closely connected, as better information extraction directly strengthens the knowledge that is fed back into the generative model. Together, this work demonstrates that aligning information extraction and generation enables smaller, specialized models to achieve strong performance while remaining practical for real-world, privacy-sensitive oncology applications.","abstract_has_math":false,"creators":["Duong, Thanh"],"institution":"University of South Florida","degree_name":"Doctor of Philosophy (Ph.D.)","degree_level":"Dissertation","degree_discipline":"Computer Science and Engineering","degree_department":null,"school":null,"contributors":["John Licato, Ph.D.","Ankur Mali, Ph.D.","Gene Louis Kim, Ph.D.","Trung Le, Ph.D.","Thanh Thieu, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":2026,"date_issued":"2026-06-25T07:00:00Z","date_published":"2026-06-25T07:00:00Z","updated_at":"2026-11-19T08:51:54Z","subjects":["NLP","LLM in Oncology","Tumor Phenotype and Disease Progression Modeling","Computer Sciences"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://digitalcommons.usf.edu/etd/11274","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://digitalcommons.usf.edu/etd/11274","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://digitalcommons.usf.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Adigitalcommons.usf.edu%3Aetd-12577","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["John Licato, Ph.D.","Ankur Mali, Ph.D.","Gene Louis Kim, Ph.D.","Trung Le, Ph.D.","Thanh Thieu, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Duong, Thanh"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date","label":"Dc Date","values":["2026-06-25T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Computer Science and Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation","Ph.D."]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy (Ph.D.)"]},{"key":"thesis:institution_name","label":"Thesis Institution Name","values":["University of South Florida"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["NLP","LLM in Oncology","Tumor Phenotype and Disease Progression Modeling","Computer Sciences"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://digitalcommons.usf.edu/etd/11274"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description","label":"Description","values":["The rapid growth of electronic health records (EHRs) has created new opportunities to apply machine learning to clinical data.However, a large portion of important clinical information is still stored in unstructured text, such as pathology reports, radiology reports, and longitudinal clinical notes.These documents contain key details about tumor characteristics, diagnoses, treatments, and patient outcomes.Extracting structured and useful information from this text is challenging due to complex medical language, varied document formats, and the need to combine information across multiple reports over time.This dissertation studies how language models can be designed and adapted to better extract and use oncology-specific information from clinical text. The work is organized into three tasks that increase in complexity. First, I study how to improve question answering by integrating structured clinical knowledge into generative language models. I develop a pipeline that uses encoder-based models to extract important clinical information and include it in prompts. This approach helps the generative model produce more accurate and clinically meaningful answers. Next, I extend my work to tumor phenotype extraction from pathology reports. This task is difficult because pathology reports are long and contain detailed clinical information. To address this, I evaluate different transformer architectures and study how well they handle long clinical text. Finally, I focus on longitudinal clinical reasoning by studying disease progression detection from patient timelines. This task is more complex because it requires combining information from multiple reports over time. I evaluate how well language models can identify progression events and study their performance under real-world class imbalance. Overall, this dissertation shows that language models can be improved by injecting structured clinical information into the generation process, leading to more accurate and clinically meaningful outputs.To support this, the second and third parts focus on identifying the most effective ways to extract high-quality clinical information from complex pathology reports and longitudinal patient data. The tumor phenotype extraction task determines the best model architectures for capturing detailed clinical attributes, while the progression detection task extends this by identifying key clinical events over time. These components are closely connected, as better information extraction directly strengthens the knowledge that is fed back into the generative model. Together, this work demonstrates that aligning information extraction and generation enables smaller, specialized models to achieve strong performance while remaining practical for real-world, privacy-sensitive oncology applications."]},{"key":"dc:title","label":"Title","values":["Language Models for Oncology Clinical Text: How Model Architecture and Data Strategies Shape Tumor Phenotype Extraction and Disease Progression Detection"]}]}],"canonical_facts":{"dc:contributor":["John Licato, Ph.D.","Ankur Mali, Ph.D.","Gene Louis Kim, Ph.D.","Trung Le, Ph.D.","Thanh Thieu, Ph.D."],"dc:creator":["Duong, Thanh"],"dc:date":["2026-06-25T07:00:00Z"],"dc:description":["The rapid growth of electronic health records (EHRs) has created new opportunities to apply machine learning to clinical data.However, a large portion of important clinical information is still stored in unstructured text, such as pathology reports, radiology reports, and longitudinal clinical notes.These documents contain key details about tumor characteristics, diagnoses, treatments, and patient outcomes.Extracting structured and useful information from this text is challenging due to complex medical language, varied document formats, and the need to combine information across multiple reports over time.This dissertation studies how language models can be designed and adapted to better extract and use oncology-specific information from clinical text. The work is organized into three tasks that increase in complexity. First, I study how to improve question answering by integrating structured clinical knowledge into generative language models. I develop a pipeline that uses encoder-based models to extract important clinical information and include it in prompts. This approach helps the generative model produce more accurate and clinically meaningful answers. Next, I extend my work to tumor phenotype extraction from pathology reports. This task is difficult because pathology reports are long and contain detailed clinical information. To address this, I evaluate different transformer architectures and study how well they handle long clinical text. Finally, I focus on longitudinal clinical reasoning by studying disease progression detection from patient timelines. This task is more complex because it requires combining information from multiple reports over time. I evaluate how well language models can identify progression events and study their performance under real-world class imbalance. Overall, this dissertation shows that language models can be improved by injecting structured clinical information into the generation process, leading to more accurate and clinically meaningful outputs.To support this, the second and third parts focus on identifying the most effective ways to extract high-quality clinical information from complex pathology reports and longitudinal patient data. The tumor phenotype extraction task determines the best model architectures for capturing detailed clinical attributes, while the progression detection task extends this by identifying key clinical events over time. These components are closely connected, as better information extraction directly strengthens the knowledge that is fed back into the generative model. Together, this work demonstrates that aligning information extraction and generation enables smaller, specialized models to achieve strong performance while remaining practical for real-world, privacy-sensitive oncology applications."],"dc:identifier":["https://digitalcommons.usf.edu/etd/11274"],"dc:subject":["NLP","LLM in Oncology","Tumor Phenotype and Disease Progression Modeling","Computer Sciences"],"dc:title":["Language Models for Oncology Clinical Text: How Model Architecture and Data Strategies Shape Tumor Phenotype Extraction and Disease Progression Detection"],"thesis:degree_discipline":["Computer Science and Engineering"],"thesis:degree_level":["Dissertation","Ph.D."],"thesis:degree_name":["Doctor of Philosophy (Ph.D.)"],"thesis:institution_name":["University of South Florida"]},"updated_at":"2026-11-19T08:51:54Z"}