Back to search

Cornell University

Online Learning Algorithms For Sequence Prediction, Importance Weighted Classification, And Active Learning

Abstract

dc:description.abstract

This thesis studies three problems in online learning. For all the problems the proposed solutions are simple yet non-trivial adaptations of existing online machine learning algorithms. For the task of sequential prediction, a modified multiplicative update algorithm that produces small and accurate models is proposed. This algorithm makes no assumption about the complexity of the source that produces the given sequence. For the task of online learning when examples have varying importances, the proposed algorithm is a version of gradient descent in continuous time. Finally, for the task of efficient online active learning, the implementation we provide makes use of many shortcuts. These include replacing a batch learning algorithm with an online one, as well as a creative use of the aforementioned continuous time gradient descent to compute the desirability of asking for the label of a given example. As this thesis shows, online machine learning algorithms can be easily adapted to many new problems.

Degree

thesis:*
Name thesis:degree_name
Ph. D., Computer Science
Level thesis:degree_level
Doctor of Philosophy
Discipline thesis:degree_discipline
Computer Science
Grantor
Cornell University
Year dc:date.issued
2012

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Karampatziakis, Nikolaos
Chair dc:contributor.chair
  • Kozen, Dexter Campbell
Committee members dc:contributor.committeemember
  • Hooker, Giles J.
  • Joachims, Thorsten
  • Kleinberg, Robert David

Subjects

dc:subject × 3

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Dc Identifier Bibid
7959860

Chain of custody

source
Harvested from
Cornell University
Base URL
ecommons.cornell.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Karampatziakis, Nikolaos. Online Learning Algorithms For Sequence Prediction, Importance Weighted Classification, And Active Learning. Doctor of Philosophy thesis, Cornell University, 2012. https://hdl.handle.net/1813/31116