1988Quarterly Journal of the Royal Meteorological SocietyRequires access

The impact of ensemble forecasts on predictability

James M. Murphy

Open publisher page 152 citations

Abstract

Abstract An estimate of the mean effect of ensemble‐averaging on forecast skill, under idealized ‘perfect model’ conditions, is obtained from a set of eight independent 50‐day winter ensemble forecast experiments made with a hemispheric version of the Meteorological Office (UKMO) 5‐level general circulation model. Each ensemble forecast consisted of seven individual integrations. Initial conditions for these were obtained by adding spatially correlated perturbations to a given wintertime analysis, and a further integration created in the same manner was used to represent nature, giving the perfect model approach. The ensemble‐mean forecast shows a clear improvement in amplitude and phase skill compared with individual forecasts, the period of significant predictability for daily fields being increased by 50%. The improvement in skill is consistent with simple theoretical estimates based on the perfect model assumption. These calculations are used to deduce how ensemble‐mean forecast skill should vary with the size of ensemble. The superiority of the ensemble‐mean is maintained when forecasts are spatially smoothed or time‐averaged. The spread of an ensemble distribution can in principle give an a priori indication of forecast skill. A moderate level of correlation between ensemble spread and the forecast skill of the ensemble‐mean is found on the hemispheric scale. The extent to which the potential benefits of ensemble forecasting may be achieved in reality depends on the model's practical forecast skill. Since the practical skill of the 5‐level model is rather low, an ensemble‐mean forecast is on average no better than an individual forecast up to the normal limit of deterministic predictability. However, in four experiments where the individual forecasts show skill beyond this point, the ensemble‐mean forecast does give increased skill. Spatial variations in both the practical and perfect model skills of an ensemble‐mean anomaly field are found to be related to corresponding variations in the statistical significance of the anomaly field. For example, the average perfect model skill, in regions where the ensemble‐mean anomaly is significantly different from zero, exceeds the full field skill in all experiments for forecast days 1–15, and in all but two cases for days 16–30.

About this research paper

What this paper is about

Abstract An estimate of the mean effect of ensemble‐averaging on forecast skill, under idealized ‘perfect model’ conditions, is obtained from a set of eight independent 50‐day winter ensemble forecast experiments made with a hemispheric version of the Meteorological Office (UKMO) 5‐level general circulation model. Each ensemble forecast consisted of seven individual integrations. Initial conditions for these were obtained by adding spatially correlated perturbations to a given wintertime analysis, and a further integration created in the same manner was used to represent nature, giving the perfect model approach. The ensemble‐mean forecast shows a clear improvement in amplitude and phase skill compared with individual forecasts, the period of significant predictability for daily fields being increased by 50%. The improvement in skill is consistent with simple theoretical estimates based on the perfect model assumption. These calculations are used to deduce how ensemble‐mean forecast skill should vary with the size of ensemble. The superiority of the ensemble‐mean is maintained when forecasts are spatially smoothed or time‐averaged. The spread of an ensemble distribution can in principle give an a priori indication of forecast skill. A moderate level of correlation between ensemble spread and the forecast skill of the ensemble‐mean is found on the hemispheric scale. The extent to which the potential benefits of ensemble forecasting may be achieved in reality depends on the model's practical forecast skill. Since the practical skill of the 5‐level model is rather low, an ensemble‐mean forecast is on average no better than an individual forecast up to the normal limit of deterministic predictability. However, in four experiments where the individual forecasts show skill beyond this point, the ensemble‐mean forecast does give increased skill. Spatial variations in both the practical and perfect model skills of an ensemble‐mean anomaly field are found to be related to corresponding variations in the statistical significance of the anomaly field. For example, the average perfect model skill, in regions where the ensemble‐mean anomaly is significantly different from zero, exceeds the full field skill in all experiments for forecast days 1–15, and in all but two cases for days 16–30.

Why it matters

OpenAlex reports 152 citations for this work. Citation counts describe recorded attention and do not establish research quality.

Key contribution

A contribution statement is not available in the OpenAlex record.

Method / approach

Method details are not available in the OpenAlex metadata.

Main findings

Findings are not separately available in the OpenAlex metadata.

Limitations

Limitations are not available in the OpenAlex metadata.

Applications

Application details are not available in the OpenAlex metadata.

Available abstract

Abstract An estimate of the mean effect of ensemble‐averaging on forecast skill, under idealized ‘perfect model’ conditions, is obtained from a set of eight independent 50‐day winter ensemble forecast experiments made with a hemispheric version of the Meteorological Office (UKMO) 5‐level general circulation model. Each ensemble forecast consisted of seven individual integrations. Initial conditions for these were obtained by adding spatially correlated perturbations to a given wintertime analysis, and a further integration created in the same manner was used to represent nature, giving the perfect model approach. The ensemble‐mean forecast shows a clear improvement in amplitude and phase skill compared with individual forecasts, the period of significant predictability for daily fields being increased by 50%. The improvement in skill is consistent with simple theoretical estimates based on the perfect model assumption. These calculations are used to deduce how ensemble‐mean forecast skill should vary with the size of ensemble. The superiority of the ensemble‐mean is maintained when forecasts are spatially smoothed or time‐averaged. The spread of an ensemble distribution can in principle give an a priori indication of forecast skill. A moderate level of correlation between ensemble spread and the forecast skill of the ensemble‐mean is found on the hemispheric scale. The extent to which the potential benefits of ensemble forecasting may be achieved in reality depends on the model's practical forecast skill. Since the practical skill of the 5‐level model is rather low, an ensemble‐mean forecast is on average no better than an individual forecast up to the normal limit of deterministic predictability. However, in four experiments where the individual forecasts show skill beyond this point, the ensemble‐mean forecast does give increased skill. Spatial variations in both the practical and perfect model skills of an ensemble‐mean anomaly field are found to be related to corresponding variations in the statistical significance of the anomaly field. For example, the average perfect model skill, in regions where the ensemble‐mean anomaly is significantly different from zero, exceeds the full field skill in all experiments for forecast days 1–15, and in all but two cases for days 16–30.

Key concepts: Predictability, Climatology, Environmental science, Ensemble forecasting, Meteorology, Mathematics, Geology, Geography

Related papers

Back to paper searchBrowse research topicsOriginal source
The impact of ensemble forecasts on predictability — Research Paper | ScholarLens