{"id":{"repo_id":"rowan","oai_identifier":"oai:rdw.rowan.edu:etd-4093"},"canonical_url":"https://search.ndltd.org/etd/rowan/oai:rdw.rowan.edu:etd-4093","repository":{"repo_id":"rowan","name":"Rowan University","base_url":"https://rdw.rowan.edu/do/oai/"},"display":{"title":"FROM POINT ESTIMATES TO PREDICTIVE DISTRIBUTIONS IN MACHINE LEARNING MODELS - A STATISTICAL IMPORTANCE SAMPLING FRAMEWORK","abstract":"In this thesis, we leverage powerful statistical frameworks for optimal sequential estimation and tracking in non-linear and non-Gaussian dynamical models, which enjoy proven (asymptotic) optimality properties. Initially, we build upon our previous work, which employed first-order Taylor series approximation to propagate the first two predictive moments, to derive Bayesian encoder-decoder networks. This work introduced the notion of dense, pixel-level uncertainty map that is crucial in fields, such as autonomous vehicles and medical segmentation. We then extended the Bayesian framework to an ensembling scheme based on ensemble Kalman Filtering (EnKF). While EnKF represents the predictive distribution with an ensemble of draws, it implicitly assumes a Gaussian model. Finally, we derived an advanced sequential importance sampling (SIS) technique to sequentially propagate random samples from the density through the model layers. The proposed importance sampling framework is able to approximate any density, not only Gaussians, has established performance guarantees and can be implemented in parallel. We demonstrate that propagating full distributions delivers significantly increased robustness to noise and adversarial attacks. Moreover, the second moment is a reliable metric to measure the model's confidence under various distributional shifts. Another notable characteristic of the model is its ability to self-assess its decisions, especially in situations where it generates inaccurate predictions. This feature represents a step towards the development of self-aware machines.","abstract_html":"In this thesis, we leverage powerful statistical frameworks for optimal sequential estimation and tracking in non-linear and non-Gaussian dynamical models, which enjoy proven (asymptotic) optimality properties. Initially, we build upon our previous work, which employed first-order Taylor series approximation to propagate the first two predictive moments, to derive Bayesian encoder-decoder networks. This work introduced the notion of dense, pixel-level uncertainty map that is crucial in fields, such as autonomous vehicles and medical segmentation. We then extended the Bayesian framework to an ensembling scheme based on ensemble Kalman Filtering (EnKF). While EnKF represents the predictive distribution with an ensemble of draws, it implicitly assumes a Gaussian model. Finally, we derived an advanced sequential importance sampling (SIS) technique to sequentially propagate random samples from the density through the model layers. The proposed importance sampling framework is able to approximate any density, not only Gaussians, has established performance guarantees and can be implemented in parallel. We demonstrate that propagating full distributions delivers significantly increased robustness to noise and adversarial attacks. Moreover, the second moment is a reliable metric to measure the model&#x27;s confidence under various distributional shifts. Another notable characteristic of the model is its ability to self-assess its decisions, especially in situations where it generates inaccurate predictions. This feature represents a step towards the development of self-aware machines.","abstract_has_math":false,"creators":["Carannante, Giuseppina"],"institution":null,"degree_name":"Ph.D. Doctor of Philosophy","degree_level":"Dissertation","degree_discipline":"Electrical and Computer Engineering","degree_department":null,"school":null,"contributors":["Nidhal C. Bouaynaya, Ph.D.","Gregory Ditzler, Ph.D.","Lyudmila S. Mihaylova, Ph.D."],"advisors":[],"committee_chairs":[],"committee_members":[],"year":null,"date_issued":"","date_published":null,"updated_at":"2026-11-19T08:59:33Z","subjects":["Bayesian Deep Learning","Machine Learning","Reliablility","Trustworthiness","Uncertainty Quantification","Statistics","Artificial Intelligence and Robotics","Electrical and Computer Engineering"],"languages":[],"rights":[],"rights_urls":[],"identifier_entries":[],"person_identifier_entries":[]},"links":{"outbound_url":"https://rdw.rowan.edu/etd/3091","outbound_label":"Repository record","outbound_source":"dc:identifier","record_url":"https://rdw.rowan.edu/etd/3091","record_label":"Repository record","record_kind":"record","record_source":"dc:identifier","download_url":null,"download_label":null,"download_source":null,"access_status":null,"embargo_until":null,"access_note":null},"source_record":{"url":"https://rdw.rowan.edu/do/oai/?verb=GetRecord&metadataPrefix=oai_etdms&identifier=oai%3Ardw.rowan.edu%3Aetd-4093","prefix":"oai_etdms"},"metadata_groups":[{"id":"people","label":"People","entries":[{"key":"dc:contributor","label":"Contributor","values":["Nidhal C. Bouaynaya, Ph.D.","Gregory Ditzler, Ph.D.","Lyudmila S. Mihaylova, Ph.D."]},{"key":"dc:creator","label":"Author","values":["Carannante, Giuseppina"]}]},{"id":"academic_context","label":"Academic Context","entries":[{"key":"dc:date.available","label":"Dc Date Available","values":["2025-04-17T07:00:00Z"]},{"key":"dc:date.created","label":"Dc Date Created","values":["2023-04-17T07:00:00Z"]},{"key":"thesis:degree_discipline","label":"Discipline","values":["Electrical and Computer Engineering"]},{"key":"thesis:degree_level","label":"Degree Level","values":["Dissertation"]},{"key":"thesis:degree_name","label":"Degree Name","values":["Ph.D. Doctor of Philosophy"]}]},{"id":"subjects_keywords","label":"Subjects and Keywords","entries":[{"key":"dc:subject","label":"Dc Subject","values":["Bayesian Deep Learning","Machine Learning","Reliablility","Trustworthiness","Uncertainty Quantification","Statistics","Artificial Intelligence and Robotics","Electrical and Computer Engineering"]}]},{"id":"identifiers","label":"Identifiers","entries":[{"key":"dc:identifier","label":"Identifier","values":["https://rdw.rowan.edu/etd/3091"]}]},{"id":"additional","label":"Additional Metadata","entries":[{"key":"dc:description.abstract","label":"Abstract","values":["In this thesis, we leverage powerful statistical frameworks for optimal sequential estimation and tracking in non-linear and non-Gaussian dynamical models, which enjoy proven (asymptotic) optimality properties. Initially, we build upon our previous work, which employed first-order Taylor series approximation to propagate the first two predictive moments, to derive Bayesian encoder-decoder networks. This work introduced the notion of dense, pixel-level uncertainty map that is crucial in fields, such as autonomous vehicles and medical segmentation. We then extended the Bayesian framework to an ensembling scheme based on ensemble Kalman Filtering (EnKF). While EnKF represents the predictive distribution with an ensemble of draws, it implicitly assumes a Gaussian model. Finally, we derived an advanced sequential importance sampling (SIS) technique to sequentially propagate random samples from the density through the model layers. The proposed importance sampling framework is able to approximate any density, not only Gaussians, has established performance guarantees and can be implemented in parallel. We demonstrate that propagating full distributions delivers significantly increased robustness to noise and adversarial attacks. Moreover, the second moment is a reliable metric to measure the model's confidence under various distributional shifts. Another notable characteristic of the model is its ability to self-assess its decisions, especially in situations where it generates inaccurate predictions. This feature represents a step towards the development of self-aware machines."]},{"key":"dc:title","label":"Title","values":["FROM POINT ESTIMATES TO PREDICTIVE DISTRIBUTIONS IN MACHINE LEARNING MODELS - A STATISTICAL IMPORTANCE SAMPLING FRAMEWORK"]}]}],"canonical_facts":{"dc:contributor":["Nidhal C. Bouaynaya, Ph.D.","Gregory Ditzler, Ph.D.","Lyudmila S. Mihaylova, Ph.D."],"dc:creator":["Carannante, Giuseppina"],"dc:date.available":["2025-04-17T07:00:00Z"],"dc:date.created":["2023-04-17T07:00:00Z"],"dc:description.abstract":["In this thesis, we leverage powerful statistical frameworks for optimal sequential estimation and tracking in non-linear and non-Gaussian dynamical models, which enjoy proven (asymptotic) optimality properties. Initially, we build upon our previous work, which employed first-order Taylor series approximation to propagate the first two predictive moments, to derive Bayesian encoder-decoder networks. This work introduced the notion of dense, pixel-level uncertainty map that is crucial in fields, such as autonomous vehicles and medical segmentation. We then extended the Bayesian framework to an ensembling scheme based on ensemble Kalman Filtering (EnKF). While EnKF represents the predictive distribution with an ensemble of draws, it implicitly assumes a Gaussian model. Finally, we derived an advanced sequential importance sampling (SIS) technique to sequentially propagate random samples from the density through the model layers. The proposed importance sampling framework is able to approximate any density, not only Gaussians, has established performance guarantees and can be implemented in parallel. We demonstrate that propagating full distributions delivers significantly increased robustness to noise and adversarial attacks. Moreover, the second moment is a reliable metric to measure the model's confidence under various distributional shifts. Another notable characteristic of the model is its ability to self-assess its decisions, especially in situations where it generates inaccurate predictions. This feature represents a step towards the development of self-aware machines."],"dc:identifier":["https://rdw.rowan.edu/etd/3091"],"dc:subject":["Bayesian Deep Learning","Machine Learning","Reliablility","Trustworthiness","Uncertainty Quantification","Statistics","Artificial Intelligence and Robotics","Electrical and Computer Engineering"],"dc:title":["FROM POINT ESTIMATES TO PREDICTIVE DISTRIBUTIONS IN MACHINE LEARNING MODELS - A STATISTICAL IMPORTANCE SAMPLING FRAMEWORK"],"thesis:degree_discipline":["Electrical and Computer Engineering"],"thesis:degree_level":["Dissertation"],"thesis:degree_name":["Ph.D. Doctor of Philosophy"]},"updated_at":"2026-11-19T08:59:33Z"}