Back to search

University of Minnesota

Online Censoring for Large-Scale Regressions and Dynamical Processes with Application to Big Data

Abstract

dc:description.abstract

In an age of exponentially increasing data availability, performing inference tasks by utilizing the available information in its entirety is not always an affordable option. In this context, the present thesis introduces different methods for rendering large-scale linear regression and tracking of dynamic processes affordable, by processing a reduced number of data. The proposed algorithms utilize interval censoring of observations, in order to judiciously discard those deemed to have relatively small contribution towards enhancing the estimation or tracking accuracy. For linear regression, two groups of first- and second-order iterative algorithms are proposed: the first one focuses on reducing data storage and transmission costs, while the second is tailored for reducing the overall problem complexity. Leveraging principles of stochastic approximation, the introduced methods entail simple, closed-form updates, provable convergence guarantees, and can afford online processing of the data. As far as the tracking of dynamical processes, two distinct methods are put forth for reducing the number of data involved per time step. The first method builds on preprocessing the data for dimensionality reduction using low-complexity random projections, while the second performs censoring for data-adaptive measurement selection. Simulations on real and synthetic data, compare the proposed methods with competing alternatives and corroborate their efficacy in terms of estimation accuracy over complexity reduction.

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Bermperidis, Dimitrios

Subjects

dc:subject × 6

Rights

Language dc:language.iso
en

Identifiers

dc:identifier.*
Dc Identifier Citation
Bermperidis, Dimitrios. (2015). Online Censoring for Large-Scale Regressions and Dynamical Processes with Application to Big Data. Retrieved from the University Digital Conservancy, https://hdl.handle.net/11299/175484.

Chain of custody

source
Harvested from
University of Minnesota
Base URL
conservancy.umn.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Bermperidis, Dimitrios. Online Censoring for Large-Scale Regressions and Dynamical Processes with Application to Big Data. 2015. http://hdl.handle.net/11299/175484