arXiv:2606.13839cs.CVcs.AI2026-06

为远程心率检测模型提供可审计的解释性分析方法

Explaining RhythmFormer: A Systematic XAI Analysis of Periodic Sparse Attention for Remote Photoplethysmography

论文配图:Explaining RhythmFormer: A Systematic XAI Analysis of Periodic Sparse Attention for Remote Photoplethysmography
图 1 · 摘自论文原文
  • 提出多跳泄漏检测机制,量化注意力路由中的信息泄露
  • 引入皮肤覆盖率与扰动一致性系数,实现可量化的解释可信度评估
  • 适用于临床级rPPG模型验证,提升解释结果的可信任度

远程光体积变化描记法(rPPG)Transformer在基准测试中表现出低心率误差,但其决策过程仍不透明,这在rPPG向临床心率估计应用推进时成为日益突出的问题。现有rPPG可解释性分析以定性热图为主,缺乏定量忠实度指标与生理学验证,导致视觉合理性与可审计证据之间存在差距。本文首次将四种归因方法(原始注意力、Rollout、Flow、Beyond Intuition)适配至RhythmFormer的双层路由注意力结构,并引入皮肤覆盖度指标,量化归因质量落在皮肤区域的比例。同时,将原用于分类任务的SaCo忠实度系数扩展至rPPG回归场景,以原始与扰动预测波形之间的平均绝对误差作为扰动影响度量。实验发现,在稀疏top-k路由下存在显著多跳泄漏:Rollout与Flow几乎完全恢复了被显式置零的连接。Beyond Intuition通过值投影加权与梯度支持掩码有效缓解该问题,在UBFC-rPPG数据集上达到最高中位皮肤覆盖度(0.83,优于基线0.57)与忠实度(F=0.92)。跨数据集与模型变体的验证表明该方法具鲁棒性。对一个低SaCo异常样本的案例研究显示,一旦人工伪影区域被替换,所有方法均一致恢复,说明归因方法族在该案例中表现出稳定的SaCo行为。这些指标推动rPPG可解释性迈向可审计的数值证据,实现更可信的解释。

原文摘要 · Abstract (English)

Remote photoplethysmography (rPPG) transformers achieve low heart-rate error on benchmarks, yet their decisions remain opaque--a growing concern as rPPG moves toward clinical heart rate estimation. Existing rPPG XAI is dominated by qualitative heatmap inspection without quantitative faithfulness metrics or physiology-grounded validation, leaving a gap between visual plausibility and auditable evidence. We address this gap. First, we adapt four attribution methods (raw attention, rollout, flow, Beyond Intuition) to RhythmFormer's bi-level routing attention with top-$k$ selection. Second, we introduce a skin coverage metric quantifying how much attribution mass falls on skin regions. Third, we adapt the SaCo faithfulness coefficient from its original classification setting to rPPG regression by using the MAE between original and perturbed predicted rPPG waveforms as the perturbation impact. Applying these tools, we quantify a multi-hop leakage effect under sparse top-$k$ routing: attention rollout and flow almost completely restores the connections that individual refined-attention layers explicitly set to zero. Beyond Intuition mitigates this via its value-projection-weighted rollout and gradient-supported mask, attaining the highest median refined skin coverage ($0.83$ vs. $0.57$ for vanilla rollout) and faithfulness ($F=0.92$) among the evaluated methods on UBFC-rPPG. Validation across diverse datasets and model variants is needed. A case study on a low-SaCo outlier further shows all four methods recovering consistently once an artefactual region is replaced, suggesting consistent SaCo behavior across attribution families in this illustrative case. Together, these metrics move XAI for rPPG toward auditable numerical evidence about spatial alignment and perturbation faithfulness, i.e. trustworthy rPPG XAI.

可解释AIrPPG注意力机制生理信号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。