Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 35 for “"hyperparameter selection"”.
-
Can Intelligent Hyperparameter Selection Improve Resistance to Adversarial Examples?
… currently available that evaluates how common hyperparameters and optimization strategies may impact a model's ability to resist these samples. This research bridges that lack of awareness, and provides a means for the selection of training and model parameters in future research on evasion …
-
Pareto Front Hyperparameter Selection for Small Metabolomics 2x2 Crossover Designs
… power, in order to improve feature selection for small 2 x 2 metabolomics crossover designs. This is done using Pareto Front Cross-Validation (PFCV) adapted with an automated hyperparameter selection criteria. PFCV is evaluated for Partial Least Squares Discriminant Analysis’s …
-
Reducing Manual Intervention in Deep Learning
… the model development pipeline, from selecting hyperparameters and optimization algorithms to evaluating model capabilities. These decisions often require extensive expertise and computational resources, creating barriers to effective model development. We present approaches for reducing human …
-
Mathematical studies in deep learning: overparameterization theories, graph generative models and applications in algorithmic pricing
… functions, offering insights into effective hyperparameter selection for such networks. Second, it proposes a novel graph data generation method, introducing an unpooling layer that leverages graph structures and resolves the non-differentiability in training using the policy gradient …
-
Mathematical studies in deep learning: overparameterization theories, graph generative models and applications in algorithmic pricing
… functions, offering insights into effective hyperparameter selection for such networks. Second, it proposes a novel graph data generation method, introducing an unpooling layer that leverages graph structures and resolves the non-differentiability in training using the policy gradient …
-
Coupled Machine Learning Models: Combining Observations and Numerical Analysis in a Physics-Regularized Approach
… methods indicate that optimized and Bayesian hyperparameter selection techniques can deliver competitive accuracy while keeping the hyperparameter tuning time low. Localized surrogates can generate forecast inferences significantly faster than global numerical analyses once a performant model …
-
Enhancing Neuromorphic Computing with Advanced Spiking Neural Network Architectures
… address the issues of training complexity, hyperparameter selection, computational flexibility, and scarcity of neuromorphic training data. The first architecture uses auxiliary learning to improve training performance and data usage, while the second architecture leverages neuromodulation …
-
On the Effect of Hyperparameters in Language Modeling for Computational Linguistics
… they frequently overlook the role of training hyperparameters as a source of randomness. In this study, by replicating three representative experiments [14, 41, 47] with hyperparameters varied over a practical range, we show that modest hyperparameter changes can alter qualitative conclusions …
-
DRAG: Diversity in Retrieval Augmented Generation through the Application of Submodular Functions
… weight decay and Facility Location. We perform hyperparameter selection for the submodular functions and for MMR. We evaluate these on five datasets designed for diversity-focused tasks (news, politics, analogies, etc). We show submodular functions outperform or match MMR's performance in nearly …
-
Efficient training of support vector machines and their hyperparameters
… respect: as for all classifiers which employ hyperparameters, the behavior of SVMs depends strongly on the particular choice of hyperparameter values, and popular approaches to training SVMs require computationally expensive grid searches to choose these parameters appropriately [1, 2]. Our …
-
Survey of Machine Learning Methods for Reactor Burnup Prediction
… with various feature engineering methods and hyperparameter selection to determine which model would be best for application in the field. Based on the studies performed in this survey, a simple ordinary least-squares polynomial regression of degree 3 and standard scaling is the fastest and …
-
Crack identification through computer vision: from non-learning-based to learning-based methodologies, and from patch-level to pixel-level detections
… systematic study to investigate the impact from hyperparameter selection on the performance of deep convolutional neural network (DCNN) on roadway crack classification; iii) achieving pixel-level crack detection resolution on image data of real-world complexities through DCNN-based roadway crack …
-
Automated autoencoder neural network architecture design
… Design (AANNAD) algorithm automates the hyperparameter selection process, iteratively generating and improving autoencoder models until a predefined resource limit is reached. This study follows a positivistic research paradigm and employs a Design Science Research methodology to evaluate …
-
Testing and learning on distributional and set inputs
… of modelling distributions in the context of hyperparameter selection for supervised learning tasks. Through transfer of information from previously solved tasks using learnt representations of the training datasets, we construct a Gaussian process framework that jointly models all the …
-
A study of the edge of stability in deep learning
… it is still unclear how to optimally set hyperparameters such as the step size for gradient descent when training neural networks. We explore the issue of tuning the step size for full batch gradient descent, examining a proposed phenomenon in the literature called the "edge of stability". …
-
Reinforcement Learning Approach for Inspect/Correct Tasks
… we characterize the impact of variability on hyperparameter selection. To help mitigate the impact of variability on RL performance, we developed a chain of -tables approach aimed at reducing the impact of subtask variability on other subtasks within a training episode. The performance of the …
-
Understanding hyperparameters in machine learning for causal estimation from observational data
… (ML). However, despite growing evidence that hyperparameters of ML methods are critical for strong predictive performance, this aspect is neglected in causality. To make matters worse, the use of observational data, while convenient due to their availability, creates serious obstacles for …
-
Optimizing supervised machine learning algorithms with practical applications.
… optimised pre-processing methods, optimise hyperparameter selections and present our own bilevel optimisation model for simultaneous training and hyperparameter tuning. We first consider the problem of predicting infrequently occurring adverse events from time series data (Provided by …
-
A Unified Framework for Deep Learning Applications in Nuclear Engineering
… In addition, it can serve as a reference for hyperparameter selection, as deep learning model performance is highly sensitive to configuration choice. To validate the effectiveness and generalizability of the proposed framework, this manuscript evaluates its performance using two fundamentally …
-
A Unified Framework for Deep Learning Applications in Nuclear Engineering
… In addition, it can serve as a reference for hyperparameter selection, as deep learning model performance is highly sensitive to configuration choice. To validate the effectiveness and generalizability of the proposed framework, this manuscript evaluates its performance using two fundamentally …
Page 1 of 2