Georgia Southern University
A Comparative Analysis of a Family of Advanced Iterative Optimization Methods in Nonlinear Regression
Abstract
dc:description.abstractClassical statistical supervised learning optimization techniques like the Gauss-Newton Iterative Method (GNIM), Weighted Gauss-Newton Iterative Method (WGNIM), Reweighted Gauss-Newton Iterative Method (RGNIM), and Levenberg-Marquart (LM) algorithm extend the nonlinear least squares method. The WGNIM improves model fitting by controlling heteroscedasticity in the linear and nonlinear models. A comparative analysis of the GNIM, WGNIM, RGNIM, and LM methods for fitting nonlinear models is presented. A step-wise diagnosis for structural multicollinearity in the reweighted linearized model is investigated via the Variance Inflation Factor (VIF) to determine variance inflation in the sequence of estimators for the model parameters. Under restricted multicollinearity levels in simulated experiments, the RGNIM outperforms the GNIM with respect to precision, while the LM is most flexible for selecting the initial parameter estimate among all of the algorithms. Meanwhile, RGNIM and WGNIM have longer computational times.
Degree
thesis:*- Name thesis:degree_name
- Master of Science in Mathematics (M.S.)
- Level thesis:degree_level
- Thesis (open access)
- Discipline thesis:degree_discipline
- Department of Mathematical Sciences
Author and committee
dc:creator, dc:contributor.*- Author dc:creator
-
- Debnath, Tanmoy Kumar
- Contributors dc:contributor
-
- Charles Champ
- Stephen Carden
- Andrew Sills
Subjects
dc:subject × 10Identifiers
dc:identifier.*- Repository record dc:identifier
- https://digitalcommons.georgiasouthern.edu/etd/2804