Back to search

University of Denver

Addressing the Problems of Data Variations, Quality, and Scarcity in Training Deep Neural Networks

Abstract

dc:description.abstract

The performance of deep neural networks (DNNs) is strongly influenced by the characteristics and quality of the underlying datasets. This Ph.D. dissertation addresses three pervasive data challenges-imbalance, quality degradation, and scarcity-that commonly hinder the effectiveness of DNNs in computer vision (CV) and natural language processing (NLP) applications. Class imbalance remains one of the most frequent causes of degraded model generalization. While Focal Loss effectively mitigates inter-class imbalance by assigning higher weights to minority classes, it struggles with intra-class imbalance, particularly in video datasets where longer clips dominate feature representation. To address this, I implement and utilize the AD-CORRE Loss, which operates at the mini-batch level to balance intra-class feature contributions with minimal computational overhead. Combined with Focal Loss, this dual-loss framework yields more stable and robust training, as demonstrated by improved empirical results across multiple CV benchmarks. Data quality represents another major factor influencing learning outcomes. Blurred or low-resolution videos and images reduce feature richness and lead to biased feature extraction. To account for this, I introduce the Combined-SSL (Self-Supervised Learning) mechanism, which jointly models video quality and classification. The integration of quality-aware supervision significantly enhances recognition performance on challenging datasets. Moreover, in an NLP setting, I apply a RoBERTa-CNN model to detect suicide intentions from well-cleaned social media posts, further demonstrating the critical role of data quality in reliable model prediction. Data scarcity poses a fundamental limitation for supervised learning, especially when labeled samples are rare or sequences are short. To alleviate this, I design a multi-task learning framework that integrates auxiliary tasks-Masked Language Modeling (MLM) and S/TP prediction-within the ProtBERT backbone. Self-supervised and physics-informed tasks enrich the feature space and improve generalization. Experimental results on IDP datasets confirm that the proposed Multi-task ProtBERT effectively mitigates data scarcity and achieves state-of-the-art performance. Overall, this dissertation provides a unified investigation into data imbalance, data quality, and data scarcity-three core bottlenecks of modern deep learning-and proposes principled solutions that improve robustness, interpretability, and efficiency across both CV and NLP domains.

Degree

thesis:*
Name thesis:degree_name
Ph.D. in Computer Science
Level thesis:degree_level
Dissertation

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Sun, Jian
Contributors dc:contributor
  • Mohammad H. Mahoor
  • Kingshuk Ghosh
  • Haluk Ogmen
  • Matt J. Rutherford

Subjects

dc:subject × 10

Rights

dc:rights
Statement dc:rights
  • <p>Copyright is held by the author. User is responsible for all copyright compliance.</p>
  • Jian Sun
Language dc:language
English (eng)

Identifiers

dc:identifier.*

Chain of custody

source
Harvested from
University of Denver
Base URL
digitalcommons.du.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Sun, Jian. Addressing the Problems of Data Variations, Quality, and Scarcity in Training Deep Neural Networks. Dissertation thesis, https://doi.org/10.56902/ETDCRP.2026.66