Back to search

Cornell University

Innovation Representations and Their Applications in Detection, Estimation, and Compression

Abstract

dc:description.abstract

Foundation models like GPT have been at the core of natural language processing, allowing a variety of downstream tasks to be achieved through fine-tuning.Potentialities of foundation models in real-time signal processing domain have been of great interest recently for their outstanding performance. Limitations of directly applying existing foundation models to real-time signals are also evident, because of the fundamental difference between the real-time signals and natural languages. In this work, we proposed the framework of utilizing innovation representations as the foundation model for real-time signals.Inspired by the Wiener-Kallianpur innovation representation of nonparametric time series, we propose the strong and weak innovation autoencoder architectures and novel deep learning algorithms that extracts the canonical independent and identically distributed innovation sequence of the time series. The innovation representations are proved to be sufficient or Bayesian sufficient statistics, which ensures that any downstream tasks based on them are lossless. Their statistical simplicity also provides efficient solutions to a wide range of inference problem with statistical guarantee. We identified three major aspects critical to the reliable and economic operation of systems: anomaly detection, forecasting, and compression.In this work, we discussed the application of innovation representations to one-class anomaly detection, probabilistic forecasting and compression of real-time signals. Both theoretical results and numerical results demonstrating the efficacy of innovation representations are presented.

Degree

thesis:*
Name thesis:degree_name
Ph. D., Electrical and Computer Engineering
Level thesis:degree_level
Doctor of Philosophy
Discipline thesis:degree_discipline
Electrical and Computer Engineering
Grantor
Cornell University
Year dc:date.issued
2024

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Wang, Xinyi
Chair dc:contributor.chair
  • Tong, Lang
Committee members dc:contributor.committeemember
  • Zhao, Qing
  • Acharya, Jayadev
  • Bunea, Florentina

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Bibid
16611888
Dc Identifier Other
ProQuest Submission ID: 14501
ProQuest Publication ID: 31486118

Chain of custody

source
Harvested from
Cornell University
Base URL
ecommons.cornell.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Wang, Xinyi. Innovation Representations and Their Applications in Detection, Estimation, and Compression. Doctor of Philosophy thesis, Cornell University, 2024. https://hdl.handle.net/1813/116610