Back to search

University of British Columbia

Exploring the potential of LLMs for biomedical relation extraction

Abstract

dc:description

Though the current state-of-the-art models for biomedical relation extraction rely on encoder-only LLMs that are pre-trained on domain-specific data and then fine-tuned using large amounts of annotated data, there is a compelling argument to explore decoder-only LLMs and alternative task formulation paradigms to investigate if similar or superior results can be achieved for this task without the need for large amounts of annotated data and computational resources. Surprisingly, there has been limited exploration of decoder-only LLMs for biomedical relation extraction. This study aims to address this gap, presenting BioREPS, a novel method that enhances decoder-only LLMs through semantic similarity and chain-of-thought prompting, yielding promising outcomes. This study highlights the effectiveness of instruction training and self-generated chain-of-thought prompts in enhancing the reasoning abilities of decoder-only LLMs for biomedical relation extraction. Additionally, this research investigates various task formulation paradigms and the empirical advantages of domain-specific training for biomedical relation extraction through a series of experiments. The results confirm that ”general” decoder-only Language Models (LLMs) hold immense potential for the task of biomedical relation extraction and come close to state-of-the-art performance with a fractional amount of data and no additional training.

Degree

thesis:*
Name thesis:degree_name
Master of Science - MSc
Level thesis:degree_level
master's
Discipline thesis:degree_discipline
Computer Science
Grantor dc:publisher
University of British Columbia
Year dc:date
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Kanwal, Swati
Contributors dc:contributor
  • Lakshmanan, Laks V. S., 1959-

Rights

dc:rights
Statement dc:rights
  • Attribution-NonCommercial-NoDerivatives 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/87686

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Kanwal, Swati. Exploring the potential of LLMs for biomedical relation extraction. master's thesis, University of British Columbia, 2024. http://hdl.handle.net/2429/87686