Book contents
- Frontmatter
- Contents
- List of contributors
- Preface
- Chapter 1 Predictability of weather and climate: from theory to practice
- Chapter 2 Predictability from a dynamical meteorological perspective
- Chapter 3 Predictability – a problem partly solved
- Chapter 4 The Liouville equation and atmospheric predictability
- Chapter 5 Application of generalised stability theory to deterministic and statistical prediction
- Chapter 6 Ensemble-based atmospheric data assimilation
- Chapter 7 Ensemble forecasting and data assimilation: two problems with the same solution?
- Chapter 8 Approximating optimal state estimation
- Chapter 9 Predictability past, predictability present
- Chapter 10 Predictability of coupled processes
- Chapter 11 Predictability of tropical intraseasonal variability
- Chapter 12 Predictability of seasonal climate variations: a pedagogical review
- Chapter 13 Predictability of the North Atlantic thermohaline circulation
- Chapter 14 On the predictability of flow-regime properties on interannual to interdecadal timescales
- Chapter 15 Model error in weather and climate forecasting
- Chapter 16 Observations, assimilation and the improvement of global weather prediction – some results from operational forecasting and ERA-40
- Chapter 17 The ECMWF Ensemble Prediction System
- Chapter 18 Limited-area ensemble forecasting: the COSMO-LEPS system
- Chapter 19 Operational seasonal prediction
- Chapter 20 Weather and seasonal climate forecasts using the superensemble approach
- Chapter 21 Predictability and targeted observations
- Chapter 22 The attributes of forecast systems: a general framework for the evaluation and calibration of weather forecasts
- Chapter 23 Predictability from a forecast provider's perspective
- Chapter 24 Ensemble forecasts: can they provide useful early warnings?
- Chapter 25 Predictability and economic value
- Chapter 26 A three-tier overlapping prediction scheme: tools for strategic and tactical decisions in the developing world
- Chapter 27 DEMETER and the application of seasonal forecasts
- Index
- Plate section
- References
Chapter 25 - Predictability and economic value
Published online by Cambridge University Press: 03 December 2009
Book contents
- Frontmatter
- Contents
- List of contributors
- Preface
- Chapter 1 Predictability of weather and climate: from theory to practice
- Chapter 2 Predictability from a dynamical meteorological perspective
- Chapter 3 Predictability – a problem partly solved
- Chapter 4 The Liouville equation and atmospheric predictability
- Chapter 5 Application of generalised stability theory to deterministic and statistical prediction
- Chapter 6 Ensemble-based atmospheric data assimilation
- Chapter 7 Ensemble forecasting and data assimilation: two problems with the same solution?
- Chapter 8 Approximating optimal state estimation
- Chapter 9 Predictability past, predictability present
- Chapter 10 Predictability of coupled processes
- Chapter 11 Predictability of tropical intraseasonal variability
- Chapter 12 Predictability of seasonal climate variations: a pedagogical review
- Chapter 13 Predictability of the North Atlantic thermohaline circulation
- Chapter 14 On the predictability of flow-regime properties on interannual to interdecadal timescales
- Chapter 15 Model error in weather and climate forecasting
- Chapter 16 Observations, assimilation and the improvement of global weather prediction – some results from operational forecasting and ERA-40
- Chapter 17 The ECMWF Ensemble Prediction System
- Chapter 18 Limited-area ensemble forecasting: the COSMO-LEPS system
- Chapter 19 Operational seasonal prediction
- Chapter 20 Weather and seasonal climate forecasts using the superensemble approach
- Chapter 21 Predictability and targeted observations
- Chapter 22 The attributes of forecast systems: a general framework for the evaluation and calibration of weather forecasts
- Chapter 23 Predictability from a forecast provider's perspective
- Chapter 24 Ensemble forecasts: can they provide useful early warnings?
- Chapter 25 Predictability and economic value
- Chapter 26 A three-tier overlapping prediction scheme: tools for strategic and tactical decisions in the developing world
- Chapter 27 DEMETER and the application of seasonal forecasts
- Index
- Plate section
- References
Summary
Introduction
To many people, probability forecasts are still much less familiar than traditional deterministic forecasts. Two issues are often raised as practical problems for the use of probabilities. First, there is a common perception that probability forecasts have no place in the real world, where users need to make hard yes/no decisions. Secondly there is the feeling that probability forecasts are difficult to assess – ‘probability forecasts are never wrong’, the scores are complicated, and different scores tend to show different ‘skill’. As an illustration of this last point, Figure 25.1 shows two examples of the evaluation of probabilistic skill for the ECMWF Ensemble Prediction System (EPS; Buizza, this volume; Palmer et al., 1993; Molteni et al., 1996; Buizza et al., 2003). The ROC skill score (based on the area under the relative operating characteristic (ROC) curve; Richardson, 2000, 2003) shows substantial skill, remaining above 40% throughout the 10-day forecast range. However, the Brier skill score (BSS; Wilks, 1995) decreases quickly so that there is no skill at all beyond day 8. Clearly, the two skill measures present contrasting perceptions of the performance of the EPS. This raises the obvious question of whether the forecasts are skilful or not and, perhaps more importantly, are the forecasts useful or not? It should be noted that these questions are not restricted to probability forecasts but are equally relevant to the more traditional deterministic forecasts.
- Type
- Chapter
- Information
- Predictability of Weather and Climate , pp. 628 - 644Publisher: Cambridge University PressPrint publication year: 2006
References
, and (2003). Benefits of increased resolution in the ECMWF ensemble system and comparison with poor-man's ensembles. Quart. J. Roy. Meteor. Soc., 129, 1269–88CrossRefGoogle Scholar
(2003). Optimization of value of aerodrome forecasts. Weather Forecast., 18, 808–242.0.CO;2>CrossRefGoogle Scholar
and (1962). The utility of weather forecasts to the raisin industry. J. Appl. Meteorol., 1, 8–122.0.CO;2>CrossRefGoogle Scholar
and (1994). Anders Angstrom and his early papers on probability forecasting and the use/value of weather forecasts. Bull. Am. Meteorol. Soc., 75, 1227–362.0.CO;2>CrossRefGoogle Scholar
(1995). Economic benefits of terminal aerodrome forecasts (TAFs) for Sydney Airport, Australia. Meteorol. Appl., 2, 239–47CrossRefGoogle Scholar
(2003). Binary events. In Forecast Verification: a Practitioner's Guide in Atmospheric Science, ed. and . WileyGoogle Scholar
, , and (1996). The ECMWF ensemble prediction system: methodology and validation. Quart. J. Roy. Meteor. Soc., 122, 73–119CrossRefGoogle Scholar
(1966). A note on the utility of probabilistic predictions and the probability score in the cost-loss ratio decision situation. J. Appl. Meteorol., 5, 534–72.0.CO;2>CrossRefGoogle Scholar
(1977). The value of climatological, categorical and probabilistic forecasts in the cost-loss ratio situation. Mon. Weather Rev., 105, 803–162.0.CO;2>CrossRefGoogle Scholar
and (1987). On the relationship between the accuracy and value of forecasts in the cost-loss ratio situation. Weather Forecast., 2, 243–512.0.CO;2>CrossRefGoogle Scholar
, , and (1993). Ensemble prediction. In ECMWF Seminar Proceeding: Validation of models over Europe, vol. 1. ECMWF, Shinfield Park, Reading, RG2 9AX, UKGoogle Scholar
(1999). The application of cost-loss models to forecast verification. In Proceedings of the 7th Workshop on Meteorological Systems. ECMWF, Shinfield Park, Reading, RG2 9AX, UK
(2000). Skill and relative economic value of the ECMWF Ensemble Prediction System. Quart. J. Roy. Meteor. Soc., 126, 649–68CrossRefGoogle Scholar
(2001). Measures of skill and value of Ensemble Prediction Systems, their interrelationship and the effect of ensemble size. Quart. J. Roy. Meteor. Soc., 127, 2473–89CrossRefGoogle Scholar
(2003). Economic value and skill. In Forecast Verification: a Practitioner's Guide in Atmospheric Science, ed. and . WileyGoogle Scholar
and (1996). The complex relationship between forecast skill and forecast value: a real-world analysis. Weather Forecast., 11, 544–592.0.CO;2>CrossRefGoogle Scholar
, and (1997). Evaluation of Probabilistic Prediction Systems. In Proceedings of the ECMWF Workshop on Predictability, 20–22 October 1997, pp. 157–66. ECMWF, Shinfield Park Reading, UKGoogle Scholar
and (2001). How to judge the quality and value of weather forecast products. Meteorol. Appl., 8, 307–14CrossRefGoogle Scholar
and (2002). On the relationship between Clayton's skill score and expected value for forecasts of binary events. Meteorol. Appl., 9, 455–9CrossRefGoogle Scholar
and (1995). Potential economic value of ensemble forecasts. Mon. Weather Rev., 123, 3565–752.0.CO;2>CrossRefGoogle Scholar
, , , and (1996). Objective evaluation of the NCEP global ensemble forecasting system. In Preprints, 15th Conference on Weather Analysis and Forecasting, Norfolk, VA, pp. J79–J82. American Meteorological SocietyGoogle Scholar
, , , and (2002). The economic value of ensemble-based weather forecasts. Bull. Am. Meteorol. Soc., 83, 73–832.3.CO;2>CrossRefGoogle Scholar
- 12
- Cited by