让文本与数据互为参照,提升流感长期预测精度
Modalities Should Talk to Each Other: Dual-Stream Multimodal Learning for Long-Horizon Influenza Forecasting

- 构建双流注意力框架,让文本与数据相互解释
- 12周前瞻预测误差降低超50%,优于多个基线模型
- 适合关注公共卫生预测与多模态融合的 researchers
长期流感样疾病(ILI)预测对公共健康准备至关重要。公开的监测数据通常将数值流行病学信号与噪声大、结构松散、与近期趋势间接相关且常滞后的文本信息配对,融合二者需精心设计。本文提出双流注意力(DSA)框架,通过36周的多模态历史数据预测12周后的ILI活动,使数值与文本流相互条件化。基于Time-MMD健康领域数据集,DSA分别使用Transformer-based数值编码器和领域适配的新闻标题编码器处理两模态,再通过双向跨模态注意力(CMA)机制耦合:文本(新闻标题)影响数值信号的解读,反之亦然。CMA输出输入因果时序模型进行预测。在十组随机种子下,DSA测试均方误差中位数为0.416,显著低于iTransformer(0.668)、TaTS(0.607)和GPT4MTS(0.851),平均误差分别降低54.95%、37.29%和67.23%,配对Cohen's d分别为0.555、0.337、0.345,且在所有自助抽样中排名第一。外地理数据集上,DSA仍为九个基线中最佳。消融实验表明优势不依赖文本编码器选择或语言模型微调,双向注意力优于单向。扰动忠实性分析显示,学习到的CMA在定向屏蔽下仍具功能意义,尤其在文本到数值方向更显著。
原文摘要 · Abstract (English)
Forecasting long-range influenza-like illness (ILI) matters for public health readiness. Publicly available surveillance datasets typically pair numeric epidemiological signals with textual information that is noisy, loosely structured, only indirectly related to near-term trends, and often lagged relative to the numeric signal. Fusing the two therefore requires careful design. We propose Dual-Stream Attention (DSA), a multimodal deep learning framework that forecasts 12-week-ahead ILI activity from a 36-week multimodal history by letting the numerical and textual streams condition each other. Using the Time-MMD health-domain dataset, DSA separately encodes the two modalities with a Transformer-based numerical encoder and a domain-adapted headline encoder, then couples them through a bidirectional Cross-Modal Attention (CMA) mechanism: the text (news headlines) conditions the interpretation of the numeric signal and vice versa. The CMA output then passes to a causal temporal model for forecasting. Evaluated across ten random seeds, DSA achieves a median test MSE of 0.416, versus 0.668, 0.607, and 0.851 for iTransformer, TaTS, and GPT4MTS, corresponding to mean-error reductions of 54.95%, 37.29%, and 67.23%, with paired Cohen's d of 0.555, 0.337, and 0.345, respectively, and ranks first in 100% of bootstrap draws. It also has substantially lower worst-window error than all baselines. On an external-geography dataset, DSA again ranks first among nine evaluated baselines. Ablations show the advantage does not depend on text-encoder choice or language-model fine-tuning, and that bidirectional attention outperforms either direction alone. Finally, perturbation-based faithfulness analysis shows the learned CMA is functionally informative under targeted masking, with a stronger effect in the text-to-numerical direction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。