2021Journal of Physics Conference SeriesOpen access

Restricted Ridge Regression estimator as a parameter estimation in multiple linear regression model for multicollinearity case

F A O Rumere, Saskya Mary Soemartojo, Yekti Widyaningsih

Open full text 8 citations

Abstract

Abstract Multiple Linear Regression analysis is one of the techniques in statistics that is used to analyse the relationship between a dependent variable and two or more independent (regressor) variables. Ordinary Least Square method is commonly used to estimate the parameters. Most frequently occurring problem in multiple linear regression analysis is the presence of multicollinearity. Multicollinearity in the least square estimation produces estimation with a large variance, so another method is needed to overcome the multicollinearity. The method is called ridge regression. In this method, a constant bias ridgekis added toX′Xmatrix. A study had developed the method by using the prior information of the parameter β and introduced the Restricted Ridge Regression method. Prior information of the parameter β was defined as a non-sample information arising from past experiences and the opinions of an expert with similar situations and containing the same parameters β. This study explains the use of Restricted Ridge Regression method in overcoming the multicollinearity in regression model. Based on an application on a data set, β of Restricted Ridge Regression has smallest mean square error (MSE) than β of Ordinary Least Square.

Open-access reader

About this research paper

What this paper is about

Abstract Multiple Linear Regression analysis is one of the techniques in statistics that is used to analyse the relationship between a dependent variable and two or more independent (regressor) variables. Ordinary Least Square method is commonly used to estimate the parameters. Most frequently occurring problem in multiple linear regression analysis is the presence of multicollinearity. Multicollinearity in the least square estimation produces estimation with a large variance, so another method is needed to overcome the multicollinearity. The method is called ridge regression. In this method, a constant bias ridgekis added toX′Xmatrix. A study had developed the method by using the prior information of the parameter β and introduced the Restricted Ridge Regression method. Prior information of the parameter β was defined as a non-sample information arising from past experiences and the opinions of an expert with similar situations and containing the same parameters β. This study explains the use of Restricted Ridge Regression method in overcoming the multicollinearity in regression model. Based on an application on a data set, β of Restricted Ridge Regression has smallest mean square error (MSE) than β of Ordinary Least Square.

Why it matters

OpenAlex reports 8 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

Abstract Multiple Linear Regression analysis is one of the techniques in statistics that is used to analyse the relationship between a dependent variable and two or more independent (regressor) variables. Ordinary Least Square method is commonly used to estimate the parameters. Most frequently occurring problem in multiple linear regression analysis is the presence of multicollinearity. Multicollinearity in the least square estimation produces estimation with a large variance, so another method is needed to overcome the multicollinearity. The method is called ridge regression. In this method, a constant bias ridgekis added toX′Xmatrix. A study had developed the method by using the prior information of the parameter β and introduced the Restricted Ridge Regression method. Prior information of the parameter β was defined as a non-sample information arising from past experiences and the opinions of an expert with similar situations and containing the same parameters β. This study explains the use of Restricted Ridge Regression method in overcoming the multicollinearity in regression model. Based on an application on a data set, β of Restricted Ridge Regression has smallest mean square error (MSE) than β of Ordinary Least Square.

Key concepts: Multicollinearity, Variance inflation factor, Statistics, Mathematics, Linear regression, Regression analysis, Regression diagnostic, Ordinary least squares

Related papers

Back to paper searchBrowse research topicsOriginal source
Restricted Ridge Regression estimator as a parameter estimation in multiple linear regression model for multicollinearity case — Research Paper | ScholarLens