Two Strategies for Removing Multicollinearity
Mustafa I. Alheety, Sharad D. Gore
Abstract
Mustafa I. Alheety, Sharad D. Gore
Abstract
In this paper, two procedures are introduced in multiple linear regression model to deal with multicollinearity: one when variables can be selected and the other when all variables must be included. Nevertheless, both these cases remove multicollinearity. This is the main result of this paper. We use the relation between the correlation matrix (R) and the variance inflation factor( VIF) for detecting multicollinearity and also for selecting variables. The first procedure does not require fitting regression of one explanatory variable on the others for computing the VIF. The second procedure replaces an explanatory variable by the residual from its regression on other explanatory variables. As a result, the final model is without multicollinearity. The performance of these procedures is compared with some recently developed methods. Three examples are used to illustrate these procedures.
OpenAlex reports 2 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
In this paper, two procedures are introduced in multiple linear regression model to deal with multicollinearity: one when variables can be selected and the other when all variables must be included. Nevertheless, both these cases remove multicollinearity. This is the main result of this paper. We use the relation between the correlation matrix (R) and the variance inflation factor( VIF) for detecting multicollinearity and also for selecting variables. The first procedure does not require fitting regression of one explanatory variable on the others for computing the VIF. The second procedure replaces an explanatory variable by the residual from its regression on other explanatory variables. As a result, the final model is without multicollinearity. The performance of these procedures is compared with some recently developed methods. Three examples are used to illustrate these procedures.
Key concepts: Multicollinearity, Variance inflation factor, Statistics, Econometrics, Linear regression, Mathematics, Design matrix, Regression analysis