Back to search

Georgia Southern University

A Comparative Analysis of a Family of Advanced Iterative Optimization Methods in Nonlinear Regression

Abstract

dc:description.abstract

Classical statistical supervised learning optimization techniques like the Gauss-Newton Iterative Method (GNIM), Weighted Gauss-Newton Iterative Method (WGNIM), Reweighted Gauss-Newton Iterative Method (RGNIM), and Levenberg-Marquart (LM) algorithm extend the nonlinear least squares method. The WGNIM improves model fitting by controlling heteroscedasticity in the linear and nonlinear models. A comparative analysis of the GNIM, WGNIM, RGNIM, and LM methods for fitting nonlinear models is presented. A step-wise diagnosis for structural multicollinearity in the reweighted linearized model is investigated via the Variance Inflation Factor (VIF) to determine variance inflation in the sequence of estimators for the model parameters. Under restricted multicollinearity levels in simulated experiments, the RGNIM outperforms the GNIM with respect to precision, while the LM is most flexible for selecting the initial parameter estimate among all of the algorithms. Meanwhile, RGNIM and WGNIM have longer computational times.

Degree

thesis:*
Name thesis:degree_name
Master of Science in Mathematics (M.S.)
Level thesis:degree_level
Thesis (open access)
Discipline thesis:degree_discipline
Department of Mathematical Sciences

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Debnath, Tanmoy Kumar
Contributors dc:contributor
  • Charles Champ
  • Stephen Carden
  • Andrew Sills

Subjects

dc:subject × 10

Identifiers

dc:identifier.*
Repository record dc:identifier
https://digitalcommons.georgiasouthern.edu/etd/2804

Chain of custody

source
Harvested from
Georgia Southern University
Base URL
digitalcommons.georgiasouthern.edu/do/oai/
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
citation

Debnath, Tanmoy Kumar. A Comparative Analysis of a Family of Advanced Iterative Optimization Methods in Nonlinear Regression. Thesis (open access) thesis, https://digitalcommons.georgiasouthern.edu/etd/2804