Cornell University
Online Learning Algorithms For Sequence Prediction, Importance Weighted Classification, And Active Learning
Abstract
dc:description.abstractThis thesis studies three problems in online learning. For all the problems the proposed solutions are simple yet non-trivial adaptations of existing online machine learning algorithms. For the task of sequential prediction, a modified multiplicative update algorithm that produces small and accurate models is proposed. This algorithm makes no assumption about the complexity of the source that produces the given sequence. For the task of online learning when examples have varying importances, the proposed algorithm is a version of gradient descent in continuous time. Finally, for the task of efficient online active learning, the implementation we provide makes use of many shortcuts. These include replacing a batch learning algorithm with an online one, as well as a creative use of the aforementioned continuous time gradient descent to compute the desirability of asking for the label of a given example. As this thesis shows, online machine learning algorithms can be easily adapted to many new problems.
Degree
thesis:*- Name thesis:degree_name
- Ph. D., Computer Science
- Level thesis:degree_level
- Doctor of Philosophy
- Discipline thesis:degree_discipline
- Computer Science
- Grantor
- Cornell University
- Year dc:date.issued
- 2012
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Karampatziakis, Nikolaos
- Chair dc:contributor.chair
-
- Kozen, Dexter Campbell
- Committee members dc:contributor.committeemember
-
- Hooker, Giles J.
- Joachims, Thorsten
- Kleinberg, Robert David
Subjects
dc:subject × 3Rights
- Language dc:language.iso
- en_US
Identifiers
dc:identifier.*- Dc Identifier Bibid
- 7959860