Quantifying forecast uncertainty

  • add_circle_outlineExpand all
  • remove_circle_outlineCollapse all

Despite the increasing accuracy of weather forecasts, there is an element of uncertainty in all predictions. In 1992, ECMWF pioneered an ensemble prediction system, which now provides a vast range of products to help forecasters deal quantitatively with the day-to-day variations in the predictability of the atmosphere.

ECMWF continues to commit a substantial research effort to the assessment of predictability at all forecast ranges (medium-range, extended and seasonal timescales), and to the investigation of methods to appropriately represent forecast uncertainty.

In any given weather forecast, there are two factors that lead forecast skill to decrease as forecast lead-time increases:

  • Inevitable uncertainties in the initial conditions
  • Necessary approximations in the construction of a numerical model of the real atmospheric system

Both of these cause errors that amplify with time. In fact, these two sources of error cannot be considered independently, since the initial conditions are themselves partly constructed through integration of the underlying numerical model (and thereby include errors resulting from the numerical model) as part of the initialisation process by data assimilation. The ECMWF ensemble forecasting system comprises the Ensemble Prediction System (ENS) for medium-range and extended forecasts, and SEAS5 for seasonal forecasts, which provide estimates of the uncertainty in a forecast.

An ensemble forecast comprises multiple realisations for a single forecast time and location. The different realisations are generated through applying different perturbations to an unperturbed (control) forecast. For the ECMWF medium-range forecasting system, the control forecast is a coarser-resolution realisation of the HRES forecast (the high-resolution forecast). The perturbed forecasts are generated through:

Perturbations to the initial conditions

The ECMWF weather prediction model is run 51 times from slightly different initial conditions. One forecast, called the ENS control forecast, is run from the HRES ECMWF analysis. An additional 50 integrations, the perturbed members, are started from slightly different initial conditions which are designed to represent the uncertainties inherent in the HRES analysis. The perturbed initial conditions are constructed from singular vectors (see e.g., Leutbecher and Palmer, 2008) and an ensemble of 4D-Var data assimilations (Buizza et al., 2008) to create 50 perturbed members (Lang et al. 2019).

Perturbations introduced at each model integration

Errors in the underlying numerical model arise from approximations in the discretisations and from assumptions in the parametrizations of unresolved processes. The resulting errors give rise to inherent uncertainty in the accuracy of the model solutions. In the ECMWF ensemble forecasting system, that uncertainty is simulated by the inclusion of the Stochastically Perturbed Parametrization Tendency scheme (SPPT, Buizza et al., 1999; Palmer et al., 2009; Leutbecher et al. 2017). SPPT represents the uncertainty from the atmospheric physics parametrization schemes by stochastically perturbing the net tendencies (excluding the heating rates due to clear-sky radiation, see Lock et al., 2019) from the atmospheric physics schemes. A detailed discussion of the stochastic parametrizations used at ECMWF and their impact on forecast skill is presented in Leutbecher et al. (2017).

  • Buizza, R., Miller, M., & Palmer, T. N. (1999), Stochastic representation of model uncertainties in the ECMWF Ensemble Prediction System. Q. J. R. Meteorol. Soc., 125, 2887-2908. doi:10.1002/qj.49712556006
  • Leutbecher, M., Lock, S.-J., Ollinaho, P., Lang, S. T. K., et al. (2017), Stochastic representations of model uncertainties at ECMWF: state of the art and future vision. Q.J.R. Meteorol. Soc, 143: 2315–2339. doi:10.1002/qj.3094
  • Lock, S.-J., Lang, S.T.K., Leutbecher, M., Hogan, R.J., Vitart, F. (2019), Treatment of model uncertainty from radiation by the Stochastically Perturbed Parametrization Tendencies (SPPT) scheme and associated revisions in the ECMWF ensembles. Q.J.R. Meteorol. Soc., 145 (Suppl. 1): 75‐ 89. doi:10.1002/qj.3570
  • Palmer, T. N., Buizza, R., Doblas-Reyes, F., Jung, T., Leutbecher, M., Shutts, G. J., Steinheimer M, & Weisheimer, A. (2009), Stochastic parametrization and model uncertainty. ECMWF RD Tech. Memo. 598, pp. 42. https://www.ecmwf.int/en/elibrary/75936-stochastic-parametrization-and-model-uncertainty, doi:10.21957/ps8gbwbdv​