构建首个统一传染病暴发预测基准数据集,支持标准化模型评估。
IDOBE: Infectious Disease Outbreak forecasting Benchmark Ecosystem

- 从百年历史数据中提取10,000+暴发事件,覆盖13种疾病
- 多模型对比显示神经网络在暴发期表现最稳定
- 适合疫情预测研究者、公共卫生建模人员使用
传染病预测已成为实时疫情响应的重要组成部分。尽管统计与机器学习模型的协同集成已成为实时预测的主流,但缺乏标准化的基准数据集来评估这些方法。此外,对于历史数据有限的新发疫情,现有方法性能仍不清晰。本文提出IDOBE,一个聚焦于暴发预测的流行病学时间序列精选集合,整合了跨越一个世纪、覆盖美国各州及全球多地的多个数据源。通过基于导数的分割方法,生成超过10,000个暴发事件,涵盖病例数与住院人数等多种结局,涉及13种疾病。我们采用多种信息论与分布度量方法量化数据集的流行病多样性。进一步,在暴发进程中进行1至4周的多时程短期预测,使用11种基线模型评估其表现,不仅包括NMSE和MAPE等点预测指标,还引入归一化加权区间评分(NWIS)等概率评分规则。结果表明,基于MLP的方法具有最稳健的表现,而统计模型在暴发前峰阶段略占优势。IDOBE数据集及基线模型已公开发布于https://github.com/NSSAC/IDOBE,旨在推动疫情预测方法的标准化与可复现评估。
原文摘要 · Abstract (English)
Epidemic forecasting has become an integral part of real-time infectious disease outbreak response. While collaborative ensembles composed of statistical and machine learning models have become the norm for real-time forecasting, standardized benchmark datasets for evaluating such methods are lacking. Further, there is limited understanding on performance of these methods for novel outbreaks with limited historical data. In this paper, we propose IDOBE, a curated collection of epidemiological time series focused on outbreak forecasting. IDOBE compiles from multiple data repositories spanning over a century of surveillance and across U.S. states and global locations. We perform derivative-based segmentation to generate over 10,000 outbreaks covering multiple outcomes such as cases and hospitalizations for 13 diseases. We consider a variety of information-theoretic and distributional measures to quantify the epidemiological diversity of the dataset. Finally, we perform multi-horizon short-term forecasting (1- to 4-week-ahead) through the progression of the outbreak using 11 baseline models and report on their performance. In addition to standard metrics such as NMSE and MAPE for point forecasts, we include probabilistic scoring rules such as Normalized Weighted Interval Score (NWIS) to quantify the performance. We find that MLP-based methods have the most robust performance, with statistical methods having a slight edge during the pre-peak phase. IDOBE dataset along with baselines are released publicly on https://github.com/NSSAC/IDOBE to enable standardized, reproducible benchmarking of outbreak forecasting methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。