Global ETD Search

Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.

Results

Showing 1 to 20 of 35 for “"hyperparameter selection"”.

  1. Can Intelligent Hyperparameter Selection Improve Resistance to Adversarial Examples?

    … currently available that evaluates how common hyperparameters and optimization strategies may impact a model's ability to resist these samples. This research bridges that lack of awareness, and provides a means for the selection of training and model parameters in future research on evasion …

    washington Repository record for Can Intelligent Hyperparameter Selection Improve Resistance to Adversarial Examples? (opens in a new tab)

  2. Pareto Front Hyperparameter Selection for Small Metabolomics 2x2 Crossover Designs

    … power, in order to improve feature selection for small 2 x 2 metabolomics crossover designs. This is done using Pareto Front Cross-Validation (PFCV) adapted with an automated hyperparameter selection criteria. PFCV is evaluated for Partial Least Squares Discriminant Analysis’s …

    guelph Repository record for Pareto Front Hyperparameter Selection for Small Metabolomics 2x2 Crossover Designs (opens in a new tab)

  3. Reducing Manual Intervention in Deep Learning

    … the model development pipeline, from selecting hyperparameters and optimization algorithms to evaluating model capabilities. These decisions often require extensive expertise and computational resources, creating barriers to effective model development. We present approaches for reducing human …

    toronto-retro Repository record for Reducing Manual Intervention in Deep Learning (opens in a new tab)

  4. Mathematical studies in deep learning: overparameterization theories, graph generative models and applications in algorithmic pricing

    … functions, offering insights into effective hyperparameter selection for such networks. Second, it proposes a novel graph data generation method, introducing an unpooling layer that leverages graph structures and resolves the non-differentiability in training using the policy gradient …

    umn Repository record for Mathematical studies in deep learning: overparameterization theories, graph generative models and applications in algorithmic pricing (opens in a new tab)

  5. Mathematical studies in deep learning: overparameterization theories, graph generative models and applications in algorithmic pricing

    … functions, offering insights into effective hyperparameter selection for such networks. Second, it proposes a novel graph data generation method, introducing an unpooling layer that leverages graph structures and resolves the non-differentiability in training using the policy gradient …

    umn Repository record for Mathematical studies in deep learning: overparameterization theories, graph generative models and applications in algorithmic pricing (opens in a new tab)

  6. Coupled Machine Learning Models: Combining Observations and Numerical Analysis in a Physics-Regularized Approach

    … methods indicate that optimized and Bayesian hyperparameter selection techniques can deliver competitive accuracy while keeping the hyperparameter tuning time low. Localized surrogates can generate forecast inferences significantly faster than global numerical analyses once a performant model …

    uno Repository record for Coupled Machine Learning Models: Combining Observations and Numerical Analysis in a Physics-Regularized Approach (opens in a new tab)

  7. Enhancing Neuromorphic Computing with Advanced Spiking Neural Network Architectures

    … address the issues of training complexity, hyperparameter selection, computational flexibility, and scarcity of neuromorphic training data. The first architecture uses auxiliary learning to improve training performance and data usage, while the second architecture leverages neuromodulation …

    vcu Repository record for Enhancing Neuromorphic Computing with Advanced Spiking Neural Network Architectures (opens in a new tab)

  8. On the Effect of Hyperparameters in Language Modeling for Computational Linguistics

    … they frequently overlook the role of training hyperparameters as a source of randomness. In this study, by replicating three representative experiments [14, 41, 47] with hyperparameters varied over a practical range, we show that modest hyperparameter changes can alter qualitative conclusions …

    waterloo Repository record for On the Effect of Hyperparameters in Language Modeling for Computational Linguistics (opens in a new tab)

  9. DRAG: Diversity in Retrieval Augmented Generation through the Application of Submodular Functions

    … weight decay and Facility Location. We perform hyperparameter selection for the submodular functions and for MMR. We evaluate these on five datasets designed for diversity-focused tasks (news, politics, analogies, etc). We show submodular functions outperform or match MMR's performance in nearly …

    washington Repository record for DRAG: Diversity in Retrieval Augmented Generation through the Application of Submodular Functions (opens in a new tab)

  10. Efficient training of support vector machines and their hyperparameters

    … respect: as for all classifiers which employ hyperparameters, the behavior of SVMs depends strongly on the particular choice of hyperparameter values, and popular approaches to training SVMs require computationally expensive grid searches to choose these parameters appropriately [1, 2]. Our …

    nwu-za Repository record for Efficient training of support vector machines and their hyperparameters (opens in a new tab)

  11. Survey of Machine Learning Methods for Reactor Burnup Prediction

    … with various feature engineering methods and hyperparameter selection to determine which model would be best for application in the field. Based on the studies performed in this survey, a simple ordinary least-squares polynomial regression of degree 3 and standard scaling is the fastest and …

    gatech Repository record for Survey of Machine Learning Methods for Reactor Burnup Prediction (opens in a new tab)

  12. Crack identification through computer vision: from non-learning-based to learning-based methodologies, and from patch-level to pixel-level detections

    … systematic study to investigate the impact from hyperparameter selection on the performance of deep convolutional neural network (DCNN) on roadway crack classification; iii) achieving pixel-level crack detection resolution on image data of real-world complexities through DCNN-based roadway crack …

    alabama Repository record for Crack identification through computer vision: from non-learning-based to learning-based methodologies, and from patch-level to pixel-level detections (opens in a new tab)

  13. Automated autoencoder neural network architecture design

    … Design (AANNAD) algorithm automates the hyperparameter selection process, iteratively generating and improving autoencoder models until a predefined resource limit is reached. This study follows a positivistic research paradigm and employs a Design Science Research methodology to evaluate …

    nwu-za Repository record for Automated autoencoder neural network architecture design (opens in a new tab)

  14. Testing and learning on distributional and set inputs

    … of modelling distributions in the context of hyperparameter selection for supervised learning tasks. Through transfer of information from previously solved tasks using learnt representations of the training datasets, we construct a Gaussian process framework that jointly models all the …

    oxford Repository record for Testing and learning on distributional and set inputs (opens in a new tab)

  15. A study of the edge of stability in deep learning

    … it is still unclear how to optimally set hyperparameters such as the step size for gradient descent when training neural networks. We explore the issue of tuning the step size for full batch gradient descent, examining a proposed phenomenon in the literature called the "edge of stability". …

    ubc Repository record for A study of the edge of stability in deep learning (opens in a new tab) Download PDF for A study of the edge of stability in deep learning (opens in a new tab)

  16. Reinforcement Learning Approach for Inspect/Correct Tasks

    … we characterize the impact of variability on hyperparameter selection. To help mitigate the impact of variability on RL performance, we developed a chain of -tables approach aimed at reducing the impact of subtask variability on other subtasks within a training episode. The performance of the …

    lsu-thes Repository record for Reinforcement Learning Approach for Inspect/Correct Tasks (opens in a new tab)

  17. Understanding hyperparameters in machine learning for causal estimation from observational data

    … (ML). However, despite growing evidence that hyperparameters of ML methods are critical for strong predictive performance, this aspect is neglected in causality. To make matters worse, the use of observational data, while convenient due to their availability, creates serious obstacles for …

    essex Download PDF for Understanding hyperparameters in machine learning for causal estimation from observational data (opens in a new tab)

  18. Optimizing supervised machine learning algorithms with practical applications.

    … optimised pre-processing methods, optimise hyperparameter selections and present our own bilevel optimisation model for simultaneous training and hyperparameter tuning. We first consider the problem of predicting infrequently occurring adverse events from time series data (Provided by …

    soton Download PDF for Optimizing supervised machine learning algorithms with practical applications. (opens in a new tab)

  19. A Unified Framework for Deep Learning Applications in Nuclear Engineering

    … In addition, it can serve as a reference for hyperparameter selection, as deep learning model performance is highly sensitive to configuration choice. To validate the effectiveness and generalizability of the proposed framework, this manuscript evaluates its performance using two fundamentally …

    tamu Repository record for A Unified Framework for Deep Learning Applications in Nuclear Engineering (opens in a new tab) Embargoed until 2028-05-01

  20. A Unified Framework for Deep Learning Applications in Nuclear Engineering

    … In addition, it can serve as a reference for hyperparameter selection, as deep learning model performance is highly sensitive to configuration choice. To validate the effectiveness and generalizability of the proposed framework, this manuscript evaluates its performance using two fundamentally …

    tamu Repository record for A Unified Framework for Deep Learning Applications in Nuclear Engineering (opens in a new tab) Embargoed until 2028-05-01

Page 1 of 2