Skip to content
PaperFren

Health behaviour

Do ensemble COVID forecasts beat single models?

Sherratt K, Gruson H, Grah R, et al. · eLife · 2023

Open access · cc0 · source: Europe PMC

Over 52 weeks and 32 European countries, a weekly multi-model ensemble beat most component models for cases and deaths, with median combining outperforming means.

How this study connects

Role on claims

Each row is a claim on a concept or method page where this paper supports, challenges, or qualifies the statement. Roles are hand-checked — not a model guess.

Not yet placed on a claim. This paper has study layers, but no concept page yet cites it as support, challenge, or qualifier.

Study at a glance

Design
Computational / modelling — European COVID-19 Forecast Hub multi-model ensemble evaluation over 52 weeks
N
N=48 · 48 unique contributing models; forecasts for 32 countries
Population
National COVID-19 case and death time series across 32 European countries
Outcome
Relative forecast accuracy (WIS) of ensemble vs component models for cases and deaths

Structured fields used in claim comparison tables when every cited study has a complete layer.

Inspect source passages

Do ensemble COVID forecasts beat single models?

These passages occur verbatim in the stored paper text. They support the points listed below; they do not verify every statement in the explanation.

48 unique models over 52 weeks.

Results: Over 52 weeks, we collected forecasts from 48 unique models.

Ensemble beat 83% of models on cases.

Across all horizons and locations, the ensemble performed better on relative WIS than 83% of participating models’ forecasts of incident cases (with a total N=886 predictions from 23 unique models), and 91% of participating models’ forecasts of deaths (N=763 predictions from 20 models).
Read passages in the original paper

Key findings

48 models contributed; the ensemble beat 83% of models on cases and 91% on deaths. Case skill fell with longer horizons while death forecasts stayed stabler; median ensembles beat mean ensembles.

Methodology

Built the European COVID-19 Forecast Hub collecting weekly 1–4 week case/death forecasts from many teams, forming an equally weighted ensemble (mean then median) and scoring with relative WIS.

Limitations

Better short-term forecasts do not automatically prescribe optimal NPIs, and past performance weighting did not reliably improve the ensemble further.

Related papers in this topic

Same topic cluster — not a recommendation engine.