Back to search

Virginia Commonwealth University

RELATIONSHIP EXTRACTION USING RETRIEVAL AUGMENTED GENERATION FOR BIOMEDICAL DATASET

Abstract

dc:description.abstract

With the increasing number of structured and unstructured data, obtaining reliable information effectively has become crucial. In the biomedical domain, extracting information from the scientific papers is crucial in order to stay up-to-date with accurate information, given the increased pace by which new research studies are published. This work focuses on identifying relationships between entities that are extracted from the abstracts and titles of biomedical research papers. In this work, we developed a Retrieval Augmented Generation (RAG) based system to automatically identify relations between biomedical entities. We evaluate multiple open source Large Language Models (LLMs) and the number of examples (shots) required to improve the LLM's results. We evaluate our methods using precision, recall and F-1 scores and compare our approach to traditional deep learning method using DeBERTa with a Convolutional Neural Network (CNN). Our results show that the Qwen-3 Reasoning model with RAG approach at 10 shots obtained the highest macro F1 than baseline approach and other LLMs using RAG at 10 shots. It performed best at 25 shots as there were least number of hallucinated label and high macro and micro score.

Degree

thesis:*
Name thesis:degree_name
Master of Science
Level thesis:degree_level
Thesis
Discipline thesis:degree_discipline
Computer Science

Author and committee

dc:creator, dc:contributor.*
Authors dc:creator
  • Jannat, Jannat
  • https://orcid.org/0009-0001-0223-6151
Contributors dc:contributor
  • Dr. Bridget McInnes

Subjects

dc:subject × 6

Rights

dc:rights
Statement dc:rights
  • © The Author

Identifiers

dc:identifier.*

Chain of custody

source
Harvested from
Virginia Commonwealth University
Base URL
scholarscompass.vcu.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Jannat, Jannat; https://orcid.org/0009-0001-0223-6151. RELATIONSHIP EXTRACTION USING RETRIEVAL AUGMENTED GENERATION FOR BIOMEDICAL DATASET. Thesis thesis, https://doi.org/10.25772/6AM3-ZA64