Back to search

University of Central Florida

Addressing Vulnerabilities and Defesne Mechanisms in Transformer-Based Language Models

Abstract

dc:description.abstract

Transformer-based Large Language Models (LLMs) have achieved remarkable success across Natural Language Processing (NLP) tasks, yet their increasing adoption has exposed critical vulnerabilities across input, model, and output layers. This dissertation systematically investigates these vulnerabilities and develops corresponding defenses, offering an end-to-end view of LLM security. First, we study model-level vulnerabilities through backdoor injection attacks that implant hidden malicious behaviors via hardware perturbations. We propose TrojBits, a hardware-aware attack that uses minimal bit-flips to insert trojans into models. Its three-stage design—Vulnerable Parameter Ranking, Hardware-Aware Attack Optimization, and Vulnerable Bit Pruning—success- fully compromises BERT and XLNet using only 64 parameters and 90 bit-flips. To counter such threats, we introduce EmbedPerturb, a defense that perturbs susceptible trojan triggers to mitigate exploitation of their original values with negligible overhead. Second, we examine prompt-level vulnerabilities through multilingual jailbreak attacks, where adversarial prompts bypass safety guardrails. Unlike prior English-focused research, we show that transliteration and chatspeak prompts can trigger unsafe responses in GPT-4 and Claude 3 Sonnet, revealing overlooked multilingual risks. We further propose SysFilter, a multilingual prompt filtering and semantic- consistency defense to neutralize such attacks. Finally, we address output-level security through watermarking, embedding detectable statistical patterns in LLM-generated text to prevent misuse. Our evaluation of four watermarking schemes under multilingual translation attacks identifies significant weaknesses in existing approaches. Building on these insights, we discuss robustness insights of the future watermarking in multilingual setting that are resilient to paraphrasing and translation. Collectively, this work bridges attack and defense perspectives, providing a unified framework for understanding and mitigating vulnerabilities in modern LLMs.

Degree

thesis:*
Grantor dc:publisher
University of Central Florida

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Al Ghanim, Mansour
Contributors dc:contributor
  • Lou, Qian

Subjects

dc:subject × 7

Identifiers

dc:identifier.*
Identifier
DP0029718

Chain of custody

source
Harvested from
Central Florida
Base URL
stars.library.ucf.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Al Ghanim, Mansour. Addressing Vulnerabilities and Defesne Mechanisms in Transformer-Based Language Models. University of Central Florida, https://stars.library.ucf.edu/etd2024/416