On the visualization, verification and recalibration of ternary probabilistic forecasts.
Jupp, Tim E;
Lowe, Rachel;
Coelho, Caio AS;
Stephenson, David B;
(2012)
On the visualization, verification and recalibration of ternary probabilistic forecasts.
Philosophical transactions Series A, Mathematical, physical, and engineering sciences, 370 (1962).
pp. 1100-1120.
ISSN 1364-503X
DOI: https://doi.org/10.1098/rsta.2011.0350
Permanent Identifier
Use this Digital Object Identifier when citing or linking to this resource.
We develop a graphical interpretation of ternary probabilistic forecasts in which forecasts and observations are regarded as points inside a triangle. Within the triangle, we define a continuous colour palette in which hue and colour saturation are defined with reference to the observed climatology. In contrast to current methods, forecast maps created with this colour scheme convey all of the information present in each ternary forecast. The geometrical interpretation is then extended to verification under quadratic scoring rules (of which the Brier score and the ranked probability score are well-known examples). Each scoring rule defines an associated triangle in which the square roots of the score, the reliability, the uncertainty and the resolution all have natural interpretations as root mean square distances. This leads to our proposal for a ternary reliability diagram in which data relating to verification and calibration can be summarized. We illustrate these ideas with data relating to seasonal forecasting of precipitation in South America, including an example of nonlinear forecast calibration. Codes implementing these ideas have been produced using the statistical software package R and are available from the authors.