Back to search

University of Southampton

Imputation by Neural Networks and Related Methods

Abstract

dc:description.abstract

<p>Neural network imputation and regression imputation are compared theoretically and numerically. In the theoretical comparison, we introduce the concept of predictive bias (pbias), which is used to measure the difference between the estimator based on full observations and the estimator based on imputed values. Let <i>y </i>be a continuous response variable, and x be the covariate of <i>y, </i><i>&theta;</i> be the parameter of interest. The estimator of <i>&theta;</i> based on the full observations is denoted <i>&theta;&#770;;.</i> The estimator based on the observed and the imputed values is denoted <i>&theta;&#770;;.<sub>I</sub></i>. Here the imputation is single imputation. The imputed data set has the same size of the full data set. Then pbias is defined as <i>E(&theta;&#770;;<sub>I</sub> - &theta;&#770;;)</i>. Due to mathematical difficulty, in the theoretical study we only consider the imputation based on the RBF neural network. We show that the performance of an imputation method depends on how the corresponding model fits the underlying model of <i>y</i>. We also show that the RBF model can be equivalent to a regression model in terms of pbias if the RBF model is properly defined and the underlying model is a linear regression model.</p> <p>A variant of nearest neighbour imputation (NNI) based on weighted distance is also proposed. This method can represent a wide range of NNIs such as Euclidean based NNI and Mahalanobis based NNI. The asymptotic form of this method and the circumstance where it outperforms other imputation methods are investigated.</p> <p>In the simulation study, we create several situations to compare neural network imputation with regression imputation and other imputation methods such as tree based imputation and NNI. The results show when a competing imputation method outperforms others.</p> <p>In the numerical study, we use a subset of 1991 household census data to compare the performance of neural network imputation with the performances of logistic regression imputation, nearest neighbour imputation weighed distance-based nearest neighbour imputation and classification tree imputation.</p>

Degree

thesis:*
Name dc:type.qualificationname
Ph.D.
Level dc:type.qualificationlevel
doctoral
Grantor dc:publisher.institution
University of Southampton
Year dc:date.issued
2002

Author and committee

dc:creator, dc:contributor.*
Author dc:creator
  • Zhao, Xinqiang

Rights

Language dc:language
English, eng

Chain of custody

source
Harvested from
University of Southampton
Base URL
eprints.soton.ac.uk/cgi/oai2
Last updated
2026-11-19
Source record
OAI-PMH GetRecord
related terms
citation

Zhao, Xinqiang. Imputation by Neural Networks and Related Methods. doctoral thesis, University of Southampton, 2002.