Standard Verification for ENSEMBLE PREDICTION MODEL SYSTEMS
Quality Control of forecast products through the unified system named VERSUS (VERification System Unified Survey) based on RDBMS system and a web-based GUI is carried out routinely at COMET. See “Deterministic Product Verifica
A Standard EPS Verification calculates probability statistical scores and diagrams for Ensemble Prediction Model Systems. The calculated EPS scores are BRIER, BRIER Skill, Brier Decomposition (Reliability, Resolution, Uncertainty), RPS (Rank Probability Score), RPSS (Rank Probability Skill Score), RPS climatology, CPRS (Cumulative Probability Skill Score), CPRSS (Cumulative Probability Skill Score), SPREAD, ERROR, ROC Area and Outliers.(See Appendix for short descriptions). Confidence intervals of scores are also calculated. The EPS diagrams are ROC, Reliability, Cost Loss and Rank. There is no possibility for the selection of EPS scores and diagrams, they are all calculated for each verification. RPS and RPSS scores are consistent only with MECE (Multi-Category Probability Forecasts) thresholds. Similarly to Standard Verification, the system displays the related report with all the verification information.