Back to search

Georgia Institute of Technology

Transitional Information Extraction

Abstract

dc:description.abstract

The practical deployment of neural networks is contingent on their ability to extract information from input data beyond a predictive output. Unfortunately, neural networks do not naturally implement this property and are explicitly optimized to compress information unrelated to the target application. For this purpose, extracting information from neural networks is frequently coupled with additional application constraints or with utilizing a collection of neural networks (or weights) that require several iterative forward passes. While each of these paradigms show promising results, each comes with a set of drawbacks that limit their deployment in the real world. Specifically, implementing constraints can result in a performance degradation on the application and iterative approaches require several forward passes which is undesirable in settings with limited computational resources. In this thesis, we address these limitations by realizing iterative methods as a sub-category of a broader family of paradigms, namely transitional information extraction. A key observation we make in this thesis is that the source representations are generalizable beyond several forward passes and can be implemented within a single neural network. Our approach is based on a detailed analysis of existing paradigms where we identify causes of performance decline for application constraints, as well as implication of limited data on the information extraction capabilities of the network. Our study results in a suite of algorithms that implement transitional information extraction in the fields of uncertainty estimation, performance regression, robustness, and underspecified settings.

Degree

thesis:*
Level thesis:degree_level
Doctoral
Department dc:contributor.department
Electrical and Computer Engineering
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Benkert, Ryan
Advisor dc:contributor.advisor
  • AlRegib, Ghassan
Committee members dc:contributor.committeemember
  • Dyer, Eva
  • Kira, Zsolt
  • Heck, Larry
  • Pananjady, Ashwin

Subjects

dc:subject × 3

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/75284

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Benkert, Ryan. Transitional Information Extraction. Doctoral thesis, Georgia Institute of Technology, 2024. https://hdl.handle.net/1853/75284