Back to search

Georgia Institute of Technology

Language Models: Generator and Labeler

Abstract

dc:description.abstract

Over the last few years, there has been remarkable progress in the capabilities of language models. These models have been trained on massive amounts of data using advanced learning algorithms, enabling them to perform a wide range of Natural Language Processing (NLP) tasks with great accuracy. This has made them highly reliable and robust, with state-of-the-art or comparable performance on various NLP benchmarks. In this thesis, I explore two uncharted territories of using large language models: hierarchical text classification and generating training data without human supervision. The proposed approach and design choices for both tasks demonstrate superior performance over different baselines. To support these claims, I examine different components of the model and analyze their contributions to the overall improvements. Although there are several limitations to using language models directly for generating training data, such as ensuring label accuracy and preserving dataset diversity, this work can inspire further research on exploiting dataset-generation-based zero-shot learning using large pre-trained language models.

Degree

thesis:*
Level thesis:degree_level
Masters
Department dc:contributor.department
Computer Science
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2023

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Rungta, Mukund
Advisor dc:contributor.advisor
  • Zhang, Chao
Committee members dc:contributor.committeemember
  • Skolnick, Jeffrey
  • Dai, Bo

Subjects

dc:subject × 3

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/75144

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Rungta, Mukund. Language Models: Generator and Labeler. Masters thesis, Georgia Institute of Technology, 2023. https://hdl.handle.net/1853/75144