Increasing the Skill of Probabilistic Forecasts: Understanding Performance Improvements from Model-Error Representations

Four model-error schemes for probabilistic forecasts over the contiguous United States with the WRF-ARW mesoscale ensemble system are evaluated in regard to performance. Including a model-error representation leads to significant increases in forecast skill near the surface as measured by the Brier...

Full description

Saved in:
Bibliographic Details
Published in:Monthly weather review 2015-04, Vol.143 (4), p.1295-1320
Main Authors: Berner, J, Fossell, K R, Ha, S-Y, Hacker, J P, Snyder, C
Format: Article
Language:English
Subjects:
Bias
Boundary conditions
Calibration
Errors
Experiments
Mathematical models
Meteorology
Methods
Probabilistic methods
Probability theory
Representations
Skills
Spreads
Studies
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Four model-error schemes for probabilistic forecasts over the contiguous United States with the WRF-ARW mesoscale ensemble system are evaluated in regard to performance. Including a model-error representation leads to significant increases in forecast skill near the surface as measured by the Brier score. Combining multiple model-error schemes results in the best-performing ensemble systems, indicating that current model error is still too complex to be represented by a single scheme alone. To understand the reasons for the improved performance, it is examined whether model-error representations increase skill merely by increasing the reliability and reducing the bias-which could also be achieved by postprocessing-or if they have additional benefits. Removing the bias results overall in the largest skill improvement. Forecasts with model-error schemes continue to have better skill than without, indicating that their benefit goes beyond bias reduction. Decomposing the Brier score into its components reveals that, in addition to the spread-sensitive reliability, the resolution component is significantly improved. This indicates that the benefits of including a model-error representation go beyond increasing reliability. This is further substantiated when all forecasts are calibrated to have similar spread. The calibrated ensembles with model-error schemes consistently outperform the calibrated control ensemble. Including a model-error representation remains beneficial even if the ensemble systems are calibrated and/or debiased. This suggests that the merits of model-error representations go beyond increasing spread and removing the mean error and can account for certain aspects of structural model uncertainty.
ISSN:0027-0644
1520-0493
DOI:10.1175/MWR-D-14-00091.1