2009•Bulletin of satistics and economicsRequires access

Two Strategies for Removing Multicollinearity

Mustafa I. Alheety, Sharad D. Gore

Open publisher page 2 citations

Abstract

In this paper, two procedures are introduced in multiple linear regression model to deal with multicollinearity: one when variables can be selected and the other when all variables must be included. Nevertheless, both these cases remove multicollinearity. This is the main result of this paper. We use the relation between the correlation matrix (R) and the variance inflation factor( VIF) for detecting multicollinearity and also for selecting variables. The first procedure does not require fitting regression of one explanatory variable on the others for computing the VIF. The second procedure replaces an explanatory variable by the residual from its regression on other explanatory variables. As a result, the final model is without multicollinearity. The performance of these procedures is compared with some recently developed methods. Three examples are used to illustrate these procedures.

About this research paper

What this paper is about

In this paper, two procedures are introduced in multiple linear regression model to deal with multicollinearity: one when variables can be selected and the other when all variables must be included. Nevertheless, both these cases remove multicollinearity. This is the main result of this paper. We use the relation between the correlation matrix (R) and the variance inflation factor( VIF) for detecting multicollinearity and also for selecting variables. The first procedure does not require fitting regression of one explanatory variable on the others for computing the VIF. The second procedure replaces an explanatory variable by the residual from its regression on other explanatory variables. As a result, the final model is without multicollinearity. The performance of these procedures is compared with some recently developed methods. Three examples are used to illustrate these procedures.

Why it matters

OpenAlex reports 2 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

In this paper, two procedures are introduced in multiple linear regression model to deal with multicollinearity: one when variables can be selected and the other when all variables must be included. Nevertheless, both these cases remove multicollinearity. This is the main result of this paper. We use the relation between the correlation matrix (R) and the variance inflation factor( VIF) for detecting multicollinearity and also for selecting variables. The first procedure does not require fitting regression of one explanatory variable on the others for computing the VIF. The second procedure replaces an explanatory variable by the residual from its regression on other explanatory variables. As a result, the final model is without multicollinearity. The performance of these procedures is compared with some recently developed methods. Three examples are used to illustrate these procedures.

Key concepts: Multicollinearity, Variance inflation factor, Statistics, Econometrics, Linear regression, Mathematics, Design matrix, Regression analysis

Related papers

Back to paper searchBrowse research topicsOriginal source
Two Strategies for Removing Multicollinearity — Research Paper | ScholarLens