Modern data analysis often involves a large number of variables, which gives rise to the problem of multicollinearity in regression models. It is well-known that in a linear model, when the design matrix X is nearly singular, then the ordinary least squares (OLS) estimator may perform poorly because of its numerical instability and large variance. To overcome this problem, many linear or nonlinear biased estimators are studied. In this work we consider a class of generalized shrunken least squares (GSLS) estimators that include many well-known linear biased estimators proposed in the literature. We compare these estimators under the mean square error and matrix mean square error criteria. Moreover, a simulation study and two numerical examples are used to illustrate some of the theoretical results.

Modern data analysis often involves a large number of variables, which gives rise to the problem of multicollinearity in regression models. It is well-known that in a linear model, when the design matrix X is nearly singular, then the ordinary least squares (OLS) estimator may perform poorly because of its numerical instability and large variance. To overcome this problem, many linear or nonlinear biased estimators are studied. In this work we consider a class of generalized shrunken least squares (GSLS) estimators that include many well-known linear biased estimators proposed in the literature. We compare these estimators under the mean square error and matrix mean square error criteria. Moreover, a simulation study and two numerical examples are used to illustrate some of the theoretical results.