On developing ridge regression parameters : a graphical investigation

In this paper we review some existing and propose some new estimators for estimating the ridge parameter. All in all 19 different estimators have been studied. The investigation has been carried out using Monte Carlo simulations. A large number of different models have been investigated where the va...

ver descrição completa

Detalhes bibliográficos
Autores: Muniz, Gisela, Golam Kibria, B. M., Mansson, Kristofer, Shukur, Ghazi
Formato: artículo
Fecha de publicación:2012
País:España
Recursos:Universitat Autònoma de Barcelona
Repositorio:Dipòsit Digital de Documents de la UAB
Idioma:inglés
OAI Identifier:oai:ddd.uab.cat:102770
Acesso em linha:https://ddd.uab.cat/record/102770
Access Level:acceso abierto
Palavra-chave:Linear model
LSE
MSE
Monte Carlo simulations
Multicollinearity
Ridge regression
Descrição
Resumo:In this paper we review some existing and propose some new estimators for estimating the ridge parameter. All in all 19 different estimators have been studied. The investigation has been carried out using Monte Carlo simulations. A large number of different models have been investigated where the variance of the random error, the number of variables included in the model, the correlations among the explanatory variables, the sample size and the unknown coefficient vector were varied. For each model we have performed 2000 replications and presented the results both in term of figures and tables. Based on the simulation study, we found that increasing the number of correlated variable, the variance of the random error and increasing the correlation between the independent variables have negative effect on the mean squared error. When the sample size increases the mean squared error decreases even when the correlation between the independent variables and the variance of the random error are large. In all situations, the proposed estimators have smaller mean squared error than the ordinary least squares and other existing estimators.