Tracking MSE efficiencies in ridge regression
D. R. Jensen, Donald E. Ramirez
Abstract
D. R. Jensen, Donald E. Ramirez
Abstract
Ridge regression is often favored in the analysis of ill-conditioned systems. A canonical form identifies regions in the parameter space where Ordinary Least Squares (OLS) is problematic. The objectives are two-fold: To reexamine the view that ill-conditioning necessarily degrades essentials of OLS; and to reassess ranges of the ridge parameter k where ridge is efficient in mean squared error (MSE) relative to OLS; and conversely. In particular, ridge is intended to ameliorate effects of ill-conditioning over a wide range of k. Contrary to conventional wisdom, ridge often must be abandoned in favor of OLS for k sufficiently large. 1.
OpenAlex reports 1 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
Ridge regression is often favored in the analysis of ill-conditioned systems. A canonical form identifies regions in the parameter space where Ordinary Least Squares (OLS) is problematic. The objectives are two-fold: To reexamine the view that ill-conditioning necessarily degrades essentials of OLS; and to reassess ranges of the ridge parameter k where ridge is efficient in mean squared error (MSE) relative to OLS; and conversely. In particular, ridge is intended to ameliorate effects of ill-conditioning over a wide range of k. Contrary to conventional wisdom, ridge often must be abandoned in favor of OLS for k sufficiently large. 1.
Key concepts: Ridge, Ordinary least squares, Regression, Statistics, Mean squared error, Mathematics, Range (aeronautics), Econometrics