Back to search

Cornell University

Sequential Decision Making With Resource Constraints

Abstract

dc:description.abstract

In sequential decision making, an algorithm interacts with an environment, where it can learn from the feedback of its past actions. A model for sequential decision making with partial feedback is the multi-armed bandit problem. This model has also found applications to a very diverse set of problems such as sequential design of experiments including medical decision-making, learning click-through rates in search engines, economic theory, network routing, etc. We study a fundamental feature in many of these applications, which is the presence of one or more limited-supply resources that are consumed during the decision process. Existing literature lacked general models for this feature and offered very limited treatment of such problems. We propose models which capture many of these applications and give tight performance guarantees.

Degree

thesis:*
Name thesis:degree_name
Ph. D., Computer Science
Level thesis:degree_level
Doctor of Philosophy
Discipline thesis:degree_discipline
Computer Science
Grantor
Cornell University
Year dc:date.issued
2014

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Badanidiyuru Varadaraja, Ashwinkumar
Chair dc:contributor.chair
  • Kleinberg, Robert David
Committee members dc:contributor.committeemember
  • Gehrke, Johannes E.
  • Tardos, Eva

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Dc Identifier Bibid
8793223

Chain of custody

source
Harvested from
Cornell University
Base URL
ecommons.cornell.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Badanidiyuru Varadaraja, Ashwinkumar. Sequential Decision Making With Resource Constraints. Doctor of Philosophy thesis, Cornell University, 2014. https://hdl.handle.net/1813/38738