Mean squared error of prediction (MSEP) estimates for principal component regression (PCR) and partial least squares regression (PLSR)
Bjørn‐Helge Mevik, Henrik René Cederkvist
Abstract
Bjørn‐Helge Mevik, Henrik René Cederkvist
Abstract
Abstract This paper presents results from simulations based on real data, comparing several competing mean squared error of prediction (MSEP) estimators on principal component regression (PCR) and partial least squares regression (PLSR): leave‐one‐out cross‐validation, K ‐fold and adjusted K ‐fold cross‐validation, the ordinary bootstrap estimate, the bootstrap smoothed cross‐validation (BCV) estimate and the 0.632 bootstrap estimate. The overall performance of the estimators is compared in terms of their bias, variance and squared error. The results indicate that the 0.632 estimate and leave‐one‐out cross‐validation are preferable when one can afford the computation. Otherwise adjusted 5‐ or 10‐fold cross‐validation are good candidates because of their computational efficiency. Copyright © 2005 John Wiley & Sons, Ltd.
OpenAlex reports 248 citations for this work. Citation counts describe recorded attention and do not establish research quality.
A contribution statement is not available in the OpenAlex record.
Method details are not available in the OpenAlex metadata.
Findings are not separately available in the OpenAlex metadata.
Limitations are not available in the OpenAlex metadata.
Application details are not available in the OpenAlex metadata.
Abstract This paper presents results from simulations based on real data, comparing several competing mean squared error of prediction (MSEP) estimators on principal component regression (PCR) and partial least squares regression (PLSR): leave‐one‐out cross‐validation, K ‐fold and adjusted K ‐fold cross‐validation, the ordinary bootstrap estimate, the bootstrap smoothed cross‐validation (BCV) estimate and the 0.632 bootstrap estimate. The overall performance of the estimators is compared in terms of their bias, variance and squared error. The results indicate that the 0.632 estimate and leave‐one‐out cross‐validation are preferable when one can afford the computation. Otherwise adjusted 5‐ or 10‐fold cross‐validation are good candidates because of their computational efficiency. Copyright © 2005 John Wiley & Sons, Ltd.
Key concepts: Partial least squares regression, Principal component regression, Statistics, Cross-validation, Estimator, Mean squared error, Ordinary least squares, Principal component analysis