arXiv:2512.07335stat.MLcs.LG2025-12

用机器学习改进事件预测,解决数据延迟问题。

Machine learning in an expectation-maximisation framework for nowcasting

  • 构建基于EM框架的机器学习模型,同时建模事件发生与报告过程。
  • 在高维特征下,非线性效应显著时性能优于传统线性方法。
  • 适用于疫情等存在延迟报告的数据场景,适合政策制定者参考。

决策常面临信息不完整的问题,导致风险被低估或高估。利用可观测信息推断完整信息的过程称为现在预测(nowcasting)。实践中,信息不完整往往源于报告或观测延迟。本文提出一种基于期望最大化(EM)框架的现在预测方法,采用机器学习技术同时建模事件的发生与报告过程。模型可纳入事件发生和报告时段的协变量信息,以及事件相关实体的特征。通过调整最大化步骤及迭代间的信道流动,有效整合神经网络与(极端)梯度提升机(XGBoost)的预测能力。模拟实验表明,在高维协变量条件下,该方法能有效建模事件发生与报告。当存在非线性关系时,其性能优于基于广义线性模型的现有EM框架。最后,将该框架应用于阿根廷新冠病例报告数据,结果再次显示基于XGBoost的方法表现最优。

原文摘要 · Abstract (English)

Decision making often occurs in the presence of incomplete information, leading to the under- or overestimation of risk. Leveraging the observable information to learn the complete information is called nowcasting. In practice, incomplete information is often a consequence of reporting or observation delays. In this paper, we propose an expectation-maximisation (EM) framework for nowcasting that uses machine learning techniques to model both the occurrence as well as the reporting process of events. We allow for the inclusion of covariate information specific to the occurrence and reporting periods as well as characteristics related to the entity for which events occurred. We demonstrate how the maximisation step and the information flow between EM iterations can be tailored to leverage the predictive power of neural networks and (extreme) gradient boosting machines (XGBoost). With simulation experiments, we show that we can effectively model both the occurrence and reporting of events when dealing with high-dimensional covariate information. In the presence of non-linear effects, we show that our methodology outperforms existing EM-based nowcasting frameworks that use generalised linear models in the maximisation step. Finally, we apply the framework to the reporting of Argentinian Covid-19 cases, where the XGBoost-based approach again is most performant.

现在预测机器学习事件建模数据延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。