University of British Columbia
Exploring the potential of LLMs for biomedical relation extraction
Abstract
dc:descriptionThough the current state-of-the-art models for biomedical relation extraction rely on encoder-only LLMs that are pre-trained on domain-specific data and then fine-tuned using large amounts of annotated data, there is a compelling argument to explore decoder-only LLMs and alternative task formulation paradigms to investigate if similar or superior results can be achieved for this task without the need for large amounts of annotated data and computational resources. Surprisingly, there has been limited exploration of decoder-only LLMs for biomedical relation extraction. This study aims to address this gap, presenting BioREPS, a novel method that enhances decoder-only LLMs through semantic similarity and chain-of-thought prompting, yielding promising outcomes. This study highlights the effectiveness of instruction training and self-generated chain-of-thought prompts in enhancing the reasoning abilities of decoder-only LLMs for biomedical relation extraction. Additionally, this research investigates various task formulation paradigms and the empirical advantages of domain-specific training for biomedical relation extraction through a series of experiments. The results confirm that ”general” decoder-only Language Models (LLMs) hold immense potential for the task of biomedical relation extraction and come close to state-of-the-art performance with a fractional amount of data and no additional training.
Degree
thesis:*- Name thesis:degree_name
- Master of Science - MSc
- Level thesis:degree_level
- master's
- Discipline thesis:degree_discipline
- Computer Science
- Grantor dc:publisher
- University of British Columbia
- Year dc:date
- 2024
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Kanwal, Swati
- Contributors dc:contributor
-
- Lakshmanan, Laks V. S., 1959-
Rights
dc:rights- Statement dc:rights
-
- Attribution-NonCommercial-NoDerivatives 4.0 International
- Language dc:language
- eng
Identifiers
dc:identifier.*- Handle dc:identifier
- http://hdl.handle.net/2429/87686