{"id":{"repo_id":"sdstate","oai_identifier":"oai:openprairie.sdstate.edu:etd2-2135"},"canonical_url":"https://search.ndltd.org/etd/sdstate/oai:openprairie.sdstate.edu:etd2-2135","repository":{"repo_id":"sdstate","name":"South Dakota State University","base_url":"https://openprairie.sdstate.edu/do/oai/"},"display":{"title":"Optimizing Large Language Models and Multimodal Approaches for Biomedical Publication and Satellite Imagery","abstract":"This dissertation comprises two main sections: the first focuses on natural language processing (NLP) for extracting key information from scientific literature using large language models (LLMs), and the second addresses remote sensing for detecting natural disasters, such as floods, from satellite imagery using a multimodal approach. The first section investigates methods to enhance Transformer-based models in classifying and extracting information from biomedical scientific publications. Key contributions include the development of a custom dataset for classification and Question and Answering (Q&A) tasks, fine-tuning Transformer models like the Bidirectional Encoder Representations from Transformers (BERT) and addressing multi-span answer issues with the TAg-based Span Extraction (TASE) model. Additionally, this explores improving classification performance by integrating citation practices into a graph model combined with existing LLMs. It also proposes FulltextAttention, a Recurrent Neural Network (RNN)-based hierarchical model, to overcome the limitations of the Transformer model’s self-attention mechanism and input sequence length constraints. The second section explores flood detection in satellite imagery through classification and semantic segmentation. Higher classification performance was achieved using a multimodal approach, combining Convolutional Neural Network (CNN) models with BERT or knowledge-graph-based Graph Convolutional Network (GCN) models. For semantic segmentation, this aims to detect flooded areas at the pixel level, proposing various multimodal concepts to improve performance over existing U-Netbased CNN models. A custom dataset was developed due to the lack of an existing benchmark, with detailed dataset development and performance analysis included. This dissertation highlights performance improvement studies on existing LLM models, dataset development, and multimodal approaches for flood detection in satellite images. It also discusses limitations and future research directions. For LLM research, dominated by large tech companies, alternative approaches like RNNs may enhance performance. For multimodal flood detection, future efforts should focus on models that maximize extraction of visual, spatial, and temporal features from satellite images, and fine-tuning the Contrastive Language-Image Pre-Training (CLIP) model for improved zero-shot classification.","abstract_html":"This dissertation comprises two main sections: the first focuses on natural language processing (NLP) for extracting key information from scientific literature using large language models (LLMs), and the second addresses remote sensing for detecting natural disasters, such as floods, from satellite imagery using a multimodal approach. The first section investigates methods to enhance Transformer-based models in classifying and extracting information from biomedical scientific publications. Key contributions include the development of a custom dataset for classification and Question and Answering (Q&amp;A) tasks, fine-tuning Transformer models like the Bidirectional Encoder Representations from Transformers (BERT) and addressing multi-span answer issues with the TAg-based Span Extraction (TASE) model. Additionally, this explores improving classification performance by integrating citation practices into a graph model combined with existing LLMs. It also proposes FulltextAttention, a Recurrent Neural Network (RNN)-based hierarchical model, to overcome the limitations of the Transformer model’s self-attention mechanism and input sequence length constraints. The second section explores flood detection in satellite imagery through classification and semantic segmentation. Higher classification performance was achieved using a multimodal approach, combining Convolutional Neural Network (CNN) models with BERT or knowledge-graph-based Graph Convolutional Network (GCN) models. For semantic segmentation, this aims to detect flooded areas at the pixel level, proposing various multimodal concepts to improve performance over existing U-Netbased CNN models. A custom dataset was developed due to the lack of an existing benchmark, with detailed dataset development and performance analysis included. This dissertation highlights performance improvement studies on existing LLM models, dataset development, and multimodal approaches for flood detection in satellite images. It also discusses limitations and future research directions. For LLM research, dominated by large tech companies, alternative approaches like RNNs may enhance performance. For multimodal flood detection, future efforts should focus on models that maximize extraction of visual, spatial, and temporal features from satellite images, and fine-tuning the Contrastive Language-Image Pre-Training (CLIP) model for improved zero-shot classification.","abstract_has_math":false,"creators":["Jang, Youngsun"],"institution":null,"degree_name":"Doctor of Philosophy (PhD)","degree_level":"Dissertation - Open Access","degree_discipline":"Electrical Engineering and Computer Science","degree_department":null,"school":null,"contributors":["Sung Shin"],"advisors":[],"committee_chairs":[],"committee_members":[],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T09:04:49Z","subjects":["Electrical and Computer Engineering"],"languages":[],"rights":[],"rights_urls":["http://rightsstatements.org/vocab/InC/1.0/"],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://openprairie.sdstate.edu/etd2/1156","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://openprairie.sdstate.edu/etd2/1156","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://openprairie.sdstate.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Aopenprairie.sdstate.edu%3Aetd2-2135","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Sung Shin"]},{"key":"dc:creator","label":"Author","values":["Jang, Youngsun"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2024-07-29T07:00:00Z"]},{"key":"dc:date.created","label":"Dc Date Created","values":["2024-01-01T08:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical Engineering and Computer Science"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation - Open Access"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Doctor of Philosophy (PhD)"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Electrical and Computer Engineering"]}]},{"id":"language_rights","label":"Language and Rights","entries":[{"key":"dc:rights","label":"Dc Rights","values":["http://rightsstatements.org/vocab/InC/1.0/"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://openprairie.sdstate.edu/etd2/1156"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["This dissertation comprises two main sections: the first focuses on natural language processing (NLP) for extracting key information from scientific literature using large language models (LLMs), and the second addresses remote sensing for detecting natural disasters, such as floods, from satellite imagery using a multimodal approach. The first section investigates methods to enhance Transformer-based models in classifying and extracting information from biomedical scientific publications. Key contributions include the development of a custom dataset for classification and Question and Answering (Q&A) tasks, fine-tuning Transformer models like the Bidirectional Encoder Representations from Transformers (BERT) and addressing multi-span answer issues with the TAg-based Span Extraction (TASE) model. Additionally, this explores improving classification performance by integrating citation practices into a graph model combined with existing LLMs. It also proposes FulltextAttention, a Recurrent Neural Network (RNN)-based hierarchical model, to overcome the limitations of the Transformer model’s self-attention mechanism and input sequence length constraints. The second section explores flood detection in satellite imagery through classification and semantic segmentation. Higher classification performance was achieved using a multimodal approach, combining Convolutional Neural Network (CNN) models with BERT or knowledge-graph-based Graph Convolutional Network (GCN) models. For semantic segmentation, this aims to detect flooded areas at the pixel level, proposing various multimodal concepts to improve performance over existing U-Netbased CNN models. A custom dataset was developed due to the lack of an existing benchmark, with detailed dataset development and performance analysis included. This dissertation highlights performance improvement studies on existing LLM models, dataset development, and multimodal approaches for flood detection in satellite images. It also discusses limitations and future research directions. For LLM research, dominated by large tech companies, alternative approaches like RNNs may enhance performance. For multimodal flood detection, future efforts should focus on models that maximize extraction of visual, spatial, and temporal features from satellite images, and fine-tuning the Contrastive Language-Image Pre-Training (CLIP) model for improved zero-shot classification."]},{"key":"dc:title","label":"Title","values":["Optimizing Large Language Models and Multimodal Approaches for Biomedical Publication and Satellite Imagery"]}]}],"canonical_facts":{"dc:contributor":["Sung Shin"],"dc:creator":["Jang, Youngsun"],"dc:date.available":["2024-07-29T07:00:00Z"],"dc:date.created":["2024-01-01T08:00:00Z"],"dc:description.abstract":["This dissertation comprises two main sections: the first focuses on natural language processing (NLP) for extracting key information from scientific literature using large language models (LLMs), and the second addresses remote sensing for detecting natural disasters, such as floods, from satellite imagery using a multimodal approach. The first section investigates methods to enhance Transformer-based models in classifying and extracting information from biomedical scientific publications. Key contributions include the development of a custom dataset for classification and Question and Answering (Q&A) tasks, fine-tuning Transformer models like the Bidirectional Encoder Representations from Transformers (BERT) and addressing multi-span answer issues with the TAg-based Span Extraction (TASE) model. Additionally, this explores improving classification performance by integrating citation practices into a graph model combined with existing LLMs. It also proposes FulltextAttention, a Recurrent Neural Network (RNN)-based hierarchical model, to overcome the limitations of the Transformer model’s self-attention mechanism and input sequence length constraints. The second section explores flood detection in satellite imagery through classification and semantic segmentation. Higher classification performance was achieved using a multimodal approach, combining Convolutional Neural Network (CNN) models with BERT or knowledge-graph-based Graph Convolutional Network (GCN) models. For semantic segmentation, this aims to detect flooded areas at the pixel level, proposing various multimodal concepts to improve performance over existing U-Netbased CNN models. A custom dataset was developed due to the lack of an existing benchmark, with detailed dataset development and performance analysis included. This dissertation highlights performance improvement studies on existing LLM models, dataset development, and multimodal approaches for flood detection in satellite images. It also discusses limitations and future research directions. For LLM research, dominated by large tech companies, alternative approaches like RNNs may enhance performance. For multimodal flood detection, future efforts should focus on models that maximize extraction of visual, spatial, and temporal features from satellite images, and fine-tuning the Contrastive Language-Image Pre-Training (CLIP) model for improved zero-shot classification."],"dc:identifier":["https://openprairie.sdstate.edu/etd2/1156"],"dc:rights":["http://rightsstatements.org/vocab/InC/1.0/"],"dc:subject":["Electrical and Computer Engineering"],"dc:title":["Optimizing Large Language Models and Multimodal Approaches for Biomedical Publication and Satellite Imagery"],"thesis:degree_discipline":["Electrical Engineering and Computer Science"],"thesis:degree_level":["Dissertation - Open Access"],"thesis:degree_name":["Doctor of Philosophy (PhD)"]},"updated_at":"2026-11-19T09:04:49Z"}