Georgia Institute of Technology
Reducing Human Labor Cost in Deep Learning for Natural Language Processing
Abstract
dc:description.abstractDeep learning has fundamentally changed the landscape of natural language processing (NLP). The success of deep learning techniques relies on huge amounts of manually labeled data in many applications. However, large amounts of labeled data are usually prohibitive or expensive to obtain. In addition, accurately evaluating the NLP models also requires expansive human evaluation. This dissertation focuses on reducing such human labor costs in deep learning for NLP. We develop novel frameworks for training deep learning models with limited/noisy annotation and a novel framework for estimating human evaluation scores. Specifically, 1. we propose a new transfer learning framework for robust and efficient fine-tuning for pre-trained models to attain better generalization performance on tasks with limited data; 2. we propose a two-stage self-training based transfer learning framework for training on weakly labeled data; 3. we propose a new reliable human-free automatic evaluation framework for dialog systems based on recent advances of off-policy evaluation in reinforcement learning.
Degree
thesis:*- Level thesis:degree_level
- Doctoral
- Department dc:contributor.department
- Industrial and Systems Engineering
- Grantor dc:publisher
- Georgia Institute of Technology
- Year dc:date.issued
- 2021
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Jiang, Haoming
- Advisor dc:contributor.advisor
-
- Zhao, Tuo
- Committee members dc:contributor.committeemember
-
- Xie, Yao
- Yang, Diyi
- Zhang, Chao
- Chen, Weizhu
Subjects
dc:subject × 6Rights
- Language dc:language.iso
- en_US
Identifiers
dc:identifier.*- Handle dc:identifier.uri
- http://hdl.handle.net/1853/64783