Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 93 for “"Generalization error"”.
-
Nearest neighbor classification using a density sensitive distance measurement [electronic resource]
… cross validation is used to determine the generalization error of each classifier. In all comparisons, k -Nearest Neighbor classification using the proposed density sensitive distance measurement had less generalization error than k -Nearest Neighbor classification using Euclidean distance. …
-
An Empirical Analysis of Predictive Machine Learning Algorithms on High-Dimensional Microarray Cancer Data
… and often both, produced lower classification error rates than randomized ensemble for all datasets used in this research. However, no one technique evaluated for classifying HDLSS microarray cancer data emerged as the universally best technique for predicting the generalization error.1 From …
-
Three essays on the use of margins to improve ensemble methods
… and Lee (1998) developed an upper bound on the generalization error of an ensemble based on the margins, from which it was concluded that larger margins should lead to lower generalization error, everything else being equal (sometimes referred to as the "large margins theory"). This result has …
-
Information-Theoretic Measures in Selected Learning Problems
… problem considered is the algorithm-dependent generalization error bound. Conceptually, the mutual information between the output of the learning algorithm and training samples captures the amount of information the algorithm learned from the samples, which reflects the overfitting. This …
-
Information-theoretic bounds in learning algorithms
… is in the area of mutual information-based generalization error bounds of supervised learning algorithms. Our bound is constructed in terms of the mutual information between each individual training sample and the output of the learning algorithm, which requires weaker conditions on the loss …
-
The Bias of Using Cross-Validation in Genomic Predictions and Its Correction
… scenarios may lead to an underestimation of the generalization error. In this work, we analyzed the bias of CV in eight methods: Ordinary Least Square (OLS), GLS, LMM, Lasso, Ridge, elastic-net (ENET), and two hybrid methods: one combining GLS with Ridge regularization (GLS+Ridge), and the other …
-
Can a Neural ODE learn a Chaotic System?
… metrics of model performance, such as generalization error, often fail to capture a neural network's ability to reproduce the invariant statistics of these complex systems. In this thesis, we demonstrate through a comprehensive set of examples that pointwise accuracy (measured through …
-
Learning and Smooth Simultaneous Estimation of Errors Based on Empirical Data
… of a new sample point is called a hypothesis' "generalization error."
-
Information-Theoretic Measures of Generalization in Machine Learning
… challenges to deploying ML methods is ensuring generalization, or the ability of the model to perform well on unseen data as well as on training data. In this thesis, we explore generalization from an information-theoretic perspective. This perspective allows us to examine the impact of learning …
-
Generalization Issues in Pattern Classification Applied to Speaker Identification
… identification, but with a primary focus on the generalization performance of patterns classifiers for speaker identification. The goal for all pattern classifiers is to generalize to new data, not just perform well on the training data set. The error on the training data is typically a biased …
-
Model-based and data-driven approaches meet redundancy in signal processing
… networks, but also to the estimation of the generalization error produced by each one of them. Regarding the latter, we take advantage of chaining techniques, in order to upper bound the Rademacher complexity of each network's hypothesis class. Then, we leverage this estimate so as to deliver …
-
Decision list machines.
… of the DAM by computing upper bounds of the generalization error.
-
Neural network approach to grading maintainability of wet areas in high rise buildings
… was found to be robust with low approximation error of 0.001 and low generalization error of 0.005. Gradings for wet areas in typical office, school and industrial buildings were found to be 92, 87 and 83 respectively. Sensitivity analysis to study the effect of each input parameter and the …
-
Program analysis for quantitative-reachability properties
… in a way that guarantees that they produce a low generalization error. An adaptive data analysis can be seen as a process composed by multiple queries interrogating some data, where the choice of which query to run next may rely on the results of previous queries. The generalization error of each …
-
Adaptive and weighted optimization for efficient and robust learning
… and led to paradigm shifts in optimization and generalization theories. Adaptive and weighted optimization have become the workhorses behind today's machine learning applications, but there is still much to learn about why they work in practice and how we can further improve their efficiency and …
-
Noisy Iterative Learning Algorithms: Optimization, Generalization, and Privacy
… Third, the theoretical understanding of the generalization performance of deep networks is limited. Gradient-based methods have been popular to perform optimization and train neural networks. One promising direction towards tackling the above challenges is the noisy, iterative algorithm which …
-
Tiesinis neuroninių tinklų kombinavimas: duomenų balinimo operacijos poveikis tiesiniam neuroninio tinklo kombinavimui su įvairaus skirtingumo ekspertais /
… than good quality similar classifiers in lower generalization error range up to 40%.
-
Semantic role labeling using rich morphological features
… is also introduced that significantly decreases generalization error, leading to state-of-the-art argument role classification results.
-
PRUNING NEURAL NETWORKS USING DETERMINANTAL POINT PROCESSES
… statistical mechanics to better understand the generalization error in a neural network pruned with a DPP in the noiseless teacher/student framework.
-
Recursive pattern based hybrid training
… applications to improve the training time and generalization accuracy of machine learning methods. In these approaches, the number and type of members in the ensemble is known to be an important factor in determining its generalization error. We present in this thesis, a recursive combination …
Page 1 of 5