Global ETD Search
Search theses and dissertations gathered from participating repositories worldwide. Every result links back to the library that holds it. No account is needed.
Results
Showing 1 to 20 of 215 for “"Cross Entropy."”.
-
Minimum cross-entropy formulations in image super-resolution
… recovery of non-negative signals is the minimum cross-entropy principle. This principle is a generalization of minimum discrimination information in statistics and information theory. In the first part of the dissertation, various minimum cross-entropy methods for super-resolution are presented. …
-
Spatial deaggregation of agricultural statistics using constrained cross entropy minimisation
… Specifically, we have used constrained cross entropy minimisation, a method which aims to minimise the difference between a target distribution and a prior assessment of the spatial distribution of land usage, while also taking certain limiting constraints into account. For our …
-
Policy Search Based Relational Reinforcement Learning using the Cross-Entropy Method
… relational “condition-action” rules using the Cross-Entropy Method (CEM) to control policy creation. The CEM assigns each rule a sampling probability and gradually modifies these probabilities such that the randomly sampled policies consist of ‘better’ rules, resulting in larger rewards …
-
Mathematical Guarantees of Near-Optimal Cross-Entropy Loss through Neural Collapse
… neural network classifiers when the training cross-entropy loss is near-optimal. Theoretically, we show that, within a small neighborhood of the optimal cross-entropy loss, with $C$ target classes, neural network classifiers with batch normalization and weight decay achieve intra-class feature …
-
Symmetric implicit geometries under label-imbalances : from cross-entropy to supervised contrastive loss
… thesis, we extend the UFM framework to analyze Cross-Entropy (CE) and Supervised Contrastive Loss (SCL) in imbalanced data. We introduce the SELI framework to characterize classifier/feature geometry under CE loss, explaining symmetric geometry on balanced datasets and predicting geometry in …
-
Rényi Cross-Entropy: Properties and Closed-Form Expressions for Sources with and without Memory
Two R ́enyi-type generalizations of the Shannon cross-entropy, the R ́enyi cross-entropy and the Natural R ́enyi cross-entropy, were recently used as loss functions for the improved design of deep learning generative adversarial networks. In this work, we analyse the properties of the R ́enyi and …
-
MULTI-AGENT FLIGHT PLANNING IN A THREE-DIMENSIONAL THREAT ENVIRONMENT USING CROSS-ENTROPY SEARCH
The multi-agent cross-entropy (CE) search method effectively optimizes flight routes in dynamic, contested three-dimensional (3D) environments where multiple aircraft must cooperate. Traditional military flight planning relies on pilots using complex and cumbersome software that lacks a …
-
Adaptive importance sampling via minimization of estimators of cross-entropy, mean square, and inefficiency constant
… minimization of well-known estimators of cross- entropy and the mean square of the IS estimator, as well as of new estimators of such a mean square and inefficiency constant. We prove the convergence and asymptotic properties of the minimization results in our methods. We show that if a …
-
GNN Convergence and Accuracy Analysis on Contextual Stochastic Block Models
… on general, nonlinear GNNs improves their cross entropy on cSBMs, and I derive the limiting accuracy of linear Graph Convolutional Networks (GCNs) on cSBMs. I use these results to derive the functional form of cross-entropy optimal GCNs on cSBMs and compare them to accuracy optimal GCNs.
-
Finding a Viable Neural Network Architecture for Use with Upper Limb Prosthetics
… architecture is a multi-entry categorical cross entropy convolutional neural network with 100% accuracy. The issue is that it is also the slowest method requiring 9 minutes to run. The next best method found was a single-entry binary cross entropy convolutional neural network, which was …
-
Stochastic Systems with Cumulative Prospect Theory
… condition; 2) showing that the well-known cross-entropy optimization algorithm is a special case of CWO-based algorithms. To the best knowledge of the author, there is no previous convergence proof for the cross-entropy method. In practice, numerical experiments have demonstrated that a …
-
Detection and localization of forgeries in digital images
… is tested using two loss functions, binary cross-entropy and weighted binary cross-entropy. Experimental results show that weighted binary cross-entropy is more efficient as a loss function for copy-move forgery while binary cross-entropy is more efficient for image splicing. In addition, …
-
Gradient free sign activation zero one loss neural networks for adversarially robust classification
… than convex surrogate losses such as hinge and cross-entropy. However, as a non-convex function, it has a large number of local minima, andits undifferentiable attribute makes it impossible to use backpropagation, a method widely used in training current state-of-the-art neural networks. When …
-
Novel Instance-Level Weighted Loss Function for Imbalanced Learning
… learning algorithms minimize the binary cross-entropy objective function to determine the final parameter estimates. This objective function assumes an equal class distribution between the minority (i.e. events) and majority (i.e. non-events) classes, which almost never exists in …
-
Differential Games of Mixed Strategies in a Variational Inference Framework: An Application to the Perimeter Defense Problem
… Min-Max SV-MPC on one hand while we extends the Cross-Entropy optimization method to a Min-Max Cross-Entropy optimization method. Moreover, we demonstrate the approach using robots as players in the perime- ter defense problem in which multiple defenders are tasked to protect a high- value target …
-
Network reliability estimation
… Sampling technique, a new technique called the Cross-Entropy method has been developed in the late 90's to find the optimal Importance Sampling parameters. By employing the Cross-Entropy technique, we propose a new scheme called the Merge Process with Cross-Entropy. The new scheme improves the …
-
Deep Contrastive Metric Learning to Detect Polymicrogyria in Pediatric Brain MRI
… cDCM Loss) to deal with this difficult problem. Cross-entropy-based loss functions do not lead to models with good generalization on small and imbalanced dataset with partially known distributions. We conduct exhaustive experiments on a modified CIFAR-10 dataset to demonstrate the efficacy of our …
Page 1 of 11