Bosse, Nikos I; Abbott, Sam; Bracher, Johannes; Hain, Habakuk; Quilty, Billy J; Jit, Mark; Centre for the Mathematical Modelling of Infectious Diseases COV; van Leeuwen, Edwin; Cori, Anne; Funk, Sebastian; (2022) Comparing human and model-based forecasts of COVID-19 in Germany and Poland. PLoS computational biology, 18 (9). e1010405-. ISSN 1553-734X DOI: https://doi.org/10.1371/journal.pcbi.1010405
Permanent Identifier
Use this Digital Object Identifier when citing or linking to this resource.
Abstract
Forecasts based on epidemiological modelling have played an important role in shaping public policy throughout the COVID-19 pandemic. This modelling combines knowledge about infectious disease dynamics with the subjective opinion of the researcher who develops and refines the model and often also adjusts model outputs. Developing a forecast model is difficult, resource- and time-consuming. It is therefore worth asking what modelling is able to add beyond the subjective opinion of the researcher alone. To investigate this, we analysed different real-time forecasts of cases of and deaths from COVID-19 in Germany and Poland over a 1-4 week horizon submitted to the German and Polish Forecast Hub. We compared crowd forecasts elicited from researchers and volunteers, against a) forecasts from two semi-mechanistic models based on common epidemiological assumptions and b) the ensemble of all other models submitted to the Forecast Hub. We found crowd forecasts, despite being overconfident, to outperform all other methods across all forecast horizons when forecasting cases (weighted interval score relative to the Hub ensemble 2 weeks ahead: 0.89). Forecasts based on computational models performed comparably better when predicting deaths (rel. WIS 1.26), suggesting that epidemiological modelling and human judgement can complement each other in important ways.
Item Type | Article |
---|---|
Faculty and Department | Faculty of Epidemiology and Population Health > Dept of Infectious Disease Epidemiology & Dynamics (2023-) |
Research Centre |
Covid-19 Research Centre for the Mathematical Modelling of Infectious Diseases |
PubMed ID | 36121848 |
Elements ID | 194793 |
Official URL | http://dx.doi.org/10.1371/journal.pcbi.1010405 |
Download
Filename: Bosse_etal_2022_Comparing-human-and-model-based.pdf
Licence: Creative Commons: Attribution 4.0
Download