Back to search

University of British Columbia

Out-of-domain few-shot learning for image classification

Abstract

dc:description

Deep learning models have consistently produced state-of-the-art results on large, labelled datasets for image classification. Although these models are highly accurate when trained on significant amounts of labeled data, generalization notably suffers when using relatively small datasets or testing on out-of-domain classes. Acquiring new, labelled samples, however, can be an expensive or impractical affair in some situations. In an attempt to address the issue of small dataset sizes, few-shot learning has risen as one prominent area of study that enables models to learn a new task from a very small amount of labelled data. Although techniques in this area have generally succeeded in improving in-domain few-shot capabilities, generalization towards out-of-domain classes remains an open research area. In this work, we address out-of-domain performance in a few-shot setting. To this end, we initially evaluate and experiment with nine state-of-the-art few-shot learning techniques on human cell classification, an out-of-domain task. We subsequently use our findings to formulate three novel techniques for improved out-of-domain few-shot learning. The first technique, Embedding Mixup for Meta-Training, leverages a modified off-line or on-line meta-training phase for improved image classification performance. Our second proposed technique, Fully Self-Supervised Few-Shot Learning, enhances the performance of label efficiency by performing self-supervised, on-line finetuning for label-less in-domain or out-of-domain few-shot learning. Finally, the third proposed technique, Masked Autoencoders for Few-Shot Learning, generates new embeddings that reinforce few-shot accuracy on in-domain and out-of-domain settings. The aforementioned techniques are extensively evaluated on standard in-domain and out-of-domain datasets to illustrate the achieved improvement in generalization and robustness towards unseen data. Overall, we show that our proposed work is capable of improving performance by up to 16% on both out-of-domain and in-domain datasets.

Degree

thesis:*
Name thesis:degree_name
Master of Science - MSc
Level thesis:degree_level
master's
Discipline thesis:degree_discipline
Computer Science
Grantor dc:publisher
University of British Columbia
Year dc:date
2023

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Walsh, Reece
Contributors dc:contributor
  • Shehata, Mohamed S.
  • Mohamed, Hashim

Rights

dc:rights
Statement dc:rights
  • Attribution-NoDerivatives 4.0 International
Language dc:language
eng

Identifiers

dc:identifier.*
Handle dc:identifier
http://hdl.handle.net/2429/84491

Chain of custody

source
Harvested from
University of British Columbia
Base URL
circle.library.ubc.ca/oai/request
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Walsh, Reece. Out-of-domain few-shot learning for image classification. master's thesis, University of British Columbia, 2023. http://hdl.handle.net/2429/84491