arXiv:2507.00234cs.LGcs.AI2025-07被引 1

融合卷积与注意力机制,实现时序数据的精准可解释可视化。

Interpretable AI for Time-Series: Multi-Model Heatmap Fusion with Global Attention and NLP-Generated Explanations

  • 用全局加权融合残差网络与重构2D Transformer的热图。
  • 在心电图和能耗数据上准确率超94%,误差降至0.28kWh。
  • 自动生成医学/工业领域语义解释,适合临床与工程人员使用。

本文提出一种新型框架,通过融合残差网络与重构2D Transformer生成的热图,并结合全局输入显著性加权,提升时序模型的可解释性。针对现有方法中时空错位问题——卷积网络缺乏全局上下文、注意力模型缺乏局部精度——本方法将梯度加权激活图与注意力传播结果融合,实现完整时空对齐且保持实时性能。在临床(心电图心律失常检测)与工业(能耗预测)数据集上的实证表明:该混合框架在PhysioNet数据集上达到94.1%准确率(F1=0.93),UCI能源设备数据集上回归误差降至RMSE=0.28 kWh(R²=0.95),优于独立的ResNet、Transformer及InceptionTime基线模型3.8%-12.4%。一个NLP模块将融合热图转化为领域特定叙述(如“2-4秒间ST段抬高提示心肌缺血”),经BLEU-4(0.586)与ROUGE-L(0.650)验证有效。通过形式化可解释性为因果保真度与时空对齐,该方法弥合技术输出与决策者理解之间的鸿沟,提供可扩展的透明化时序决策支持。

原文摘要 · Abstract (English)

In this paper, we present a novel framework for enhancing model interpretability by integrating heatmaps produced separately by ResNet and a restructured 2D Transformer with globally weighted input saliency. We address the critical problem of spatial-temporal misalignment in existing interpretability methods, where convolutional networks fail to capture global context and Transformers lack localized precision - a limitation that impedes actionable insights in safety-critical domains like healthcare and industrial monitoring. Our method merges gradient-weighted activation maps (ResNet) and Transformer attention rollout into a unified visualization, achieving full spatial-temporal alignment while preserving real-time performance. Empirical evaluations on clinical (ECG arrhythmia detection) and industrial (energy consumption prediction) datasets demonstrate significant improvements: the hybrid framework achieves 94.1% accuracy (F1 0.93) on the PhysioNet dataset and reduces regression error to RMSE = 0.28 kWh (R2 = 0.95) on the UCI Energy Appliance dataset-outperforming standalone ResNet, Transformer, and InceptionTime baselines by 3.8-12.4%. An NLP module translates fused heatmaps into domain-specific narratives (e.g., "Elevated ST-segment between 2-4 seconds suggests myocardial ischemia"), validated via BLEU-4 (0.586) and ROUGE-L (0.650) scores. By formalizing interpretability as causal fidelity and spatial-temporal alignment, our approach bridges the gap between technical outputs and stakeholder understanding, offering a scalable solution for transparent, time-aware decision-making.

时序可解释热图融合医疗诊断NLP生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。