Back to search

Georgia Institute of Technology

Evaluating Visual Classification Models On Out-of-distribution Shifts With Limited Training Data

Abstract

dc:description.abstract

Deep Learning has led to major breakthroughs for several Artificial Intelligence tasks. As such models are increasingly deployed in real-world applications, it is necessary that they perform reliably not only on the training dataset(s) but also on different kinds of (out-of) distribution shifts. In this thesis, we focus on two problem settings where out-of-distribution (OOD) classification performance is measured with limited (order of thousand images) training data -- unsupervised domain adaptation and robustness to natural distribution shifts. Overall, this thesis demonstrates that (1) such models can be better utilised for unsupervised domain adaptation and (2) conventional wisdom for OOD robustness might not apply when the amount of fine-tuning data is not as high. We hope to motivate future researchers to also focus on this setting of practical importance.

Degree

thesis:*
Level thesis:degree_level
Masters
Department dc:contributor.department
Computer Science
Grantor dc:publisher
Georgia Institute of Technology
Year dc:date.issued
2023

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Singh, Aaditya
Advisor dc:contributor.advisor
  • Hoffman, Judy
Committee members dc:contributor.committeemember
  • Kira, Zsolt
  • Xu, Danfei

Subjects

dc:subject × 5

Rights

Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
https://hdl.handle.net/1853/71968

Chain of custody

source
Harvested from
Georgia Tech
Base URL
repository.gatech.edu/server/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Singh, Aaditya. Evaluating Visual Classification Models On Out-of-distribution Shifts With Limited Training Data. Masters thesis, Georgia Institute of Technology, 2023. https://hdl.handle.net/1853/71968