Georgia Institute of Technology
Model Uncertainty-Aware Differentiable Architecture Search
Abstract
dc:description.abstractWe present a Model Uncertainty-aware Differentiable ARchiTecture Search (μDARTS) that optimizes neural networks to achieve high accuracy and low uncertainty simultaneously. We introduce concrete dropout within DARTS cells and include a Monte-Carlo regularizer within the training loss to optimize the concrete dropout probabilities. A predictive variance term is introduced in the validation loss to enable searching for architecture with minimal model uncertainty. The experiments on CIFAR10, CIFAR100, SVHN, and ImageNet verify the effectiveness of μDARTS in improving accuracy and reducing uncertainty compared to existing DARTS methods. Moreover, the final architecture obtained from μDARTS shows higher robustness to noise at the input image and model parameters compared to the architecture obtained from existing DARTS methods.
Degree
thesis:*- Level thesis:degree_level
- Masters
- Department dc:contributor.department
- Electrical and Computer Engineering
- Grantor dc:publisher
- Georgia Institute of Technology
- Year dc:date.issued
- 2023
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Chakraborty, Biswadeep
- Advisor dc:contributor.advisor
-
- Mukhopadhyay, Saibal
- Committee members dc:contributor.committeemember
-
- Yu, Shimeng
- Hao, Callie
Subjects
dc:subject × 6Rights
- Language dc:language.iso
- en_US
Identifiers
dc:identifier.*- Handle dc:identifier.uri
- https://hdl.handle.net/1853/75176