Restricted Ridge Regression estimator as a parameter estimation in multiple linear regression model for multicollinearity case
F A O Rumere, Saskya Mary Soemartojo, Yekti Widyaningsih
Abstract
Open-access reader
F A O Rumere, Saskya Mary Soemartojo, Yekti Widyaningsih
Abstract
Open-access reader
Abstract Multiple Linear Regression analysis is one of the techniques in statistics that is used to analyse the relationship between a dependent variable and two or more independent (regressor) variables. Ordinary Least Square method is commonly used to estimate the parameters. Most frequently occurring problem in multiple linear regression analysis is the presence of multicollinearity. Multicollinearity in the least square estimation produces estimation with a large variance, so another method is needed to overcome the multicollinearity. The method is called ridge regression. In this method, a constant bias ridgekis added toX′Xmatrix. A study had developed the method by using the prior information of the parameter β and introduced the Restricted Ridge Regression method. Prior information of the parameter β was defined as a non-sample information arising from past experiences and the opinions of an expert with similar situations and containing the same parameters β. This study explains the use of Restricted Ridge Regression method in overcoming the multicollinearity in regression model. Based on an application on a data set, β of Restricted Ridge Regression has smallest mean square error (MSE) than β of Ordinary Least Square.
OpenAlex reports 8 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
Abstract Multiple Linear Regression analysis is one of the techniques in statistics that is used to analyse the relationship between a dependent variable and two or more independent (regressor) variables. Ordinary Least Square method is commonly used to estimate the parameters. Most frequently occurring problem in multiple linear regression analysis is the presence of multicollinearity. Multicollinearity in the least square estimation produces estimation with a large variance, so another method is needed to overcome the multicollinearity. The method is called ridge regression. In this method, a constant bias ridgekis added toX′Xmatrix. A study had developed the method by using the prior information of the parameter β and introduced the Restricted Ridge Regression method. Prior information of the parameter β was defined as a non-sample information arising from past experiences and the opinions of an expert with similar situations and containing the same parameters β. This study explains the use of Restricted Ridge Regression method in overcoming the multicollinearity in regression model. Based on an application on a data set, β of Restricted Ridge Regression has smallest mean square error (MSE) than β of Ordinary Least Square.
Key concepts: Multicollinearity, Variance inflation factor, Statistics, Mathematics, Linear regression, Regression analysis, Regression diagnostic, Ordinary least squares