Back to search

University of Washington

The Effects of Hybrid Neural Networks on Meta-Learning Objectives

Abstract

dc:description.abstract

Historically, deep neural networks do not generalize well when they are trained solely on adataset/task’s objective, despite the plethora of data and computing available in the modern digital era. We propose that this is due, at least partially, to the model representations being inflexible. In this paper, we experiment with a hybrid neural network architecture that has an unsupervised model at its head (the Knowledge Representation module) and a supervised model at its tail (the Task Inference module) with the idea that we can supplement the learning of a set of related tasks with a reusable knowledge base. We analyze the two-part model in the contexts of transfer learning, few-shot learning, and curriculum learning, and train on the MNIST and SVHN datasets. The results of the experiment demonstrate that our architecture on average achieves a similar test accuracy as the end-to-end baselines, and sometimes marginally better in certain experiments depending on the sub-network combination.

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Varela, Franz Anthony
Advisor dc:contributor.advisor
  • Stiber, Michael

Subjects

dc:subject × 9

Rights

dc:rights
Statement dc:rights
  • CC BY
Language dc:language.iso
en_US

Identifiers

dc:identifier.*
Handle dc:identifier.uri
http://hdl.handle.net/1773/48897

Chain of custody

source
Harvested from
University of Washington
Base URL
digital.lib.washington.edu/server/oai/request
Last updated
2026-11-18
Source record
OAI-PMH GetRecord
citation

Varela, Franz Anthony. The Effects of Hybrid Neural Networks on Meta-Learning Objectives. 2022. http://hdl.handle.net/1773/48897