用因果干预提升远距离心率测量的自监督学习效果
Intervention-Based Self-Supervised Learning: A Causal Probe Paradigm for Remote Photoplethysmography

- 通过主动干预视频中的色度成分验证生理信号假设
- 在VIPL-HR和MMPD数据集上显著提升跨域性能
- 有效抑制运动与光照干扰,适合复杂环境应用
远距离光体积描记(rPPG)可实现非接触式生理监测。现有自监督学习方法常陷入相关性陷阱:过度学习高能量的运动或光照噪声等主导信号,而非微弱的真实rPPG信号,导致泛化能力差。为此,我们提出新的自监督范式——生理因果探测(PCP),将潜在rPPG信号视为物理源头,像素色度变化为其视觉表现。核心思路是从被动相关学习转向主动精确干预:基于提出的rPPG假设对视频进行干预,并验证干预后变化是否符合物理预期。我们构建了Interv-rPPG框架:由PhysMambaFormer提取rPPG信号,通过可控生理信号编辑器在色度域精准干预视频。该方法通过‘零化可证伪性’与‘公理等变性’验证假设的物理合理性。编辑器通过对视频低频色度成分干预,精确调控rPPG信号。实验表明,该方法在VIPL-HR和MMPD等挑战性数据集上提升域内与跨域性能;在复杂跨数据集场景中超越监督基线,而在干净数据集上仍具竞争力(干预可能引入轻微残余色度噪声)。诊断分析显示,PCP范式能有效抵抗运动与光照伪影。
原文摘要 · Abstract (English)
Remote Photoplethysmography (rPPG) enables convenient non-contact physiological measurement. Existing Self-Supervised Learning (SSL) methods commonly fall into a correlation trap: they tend to learn the most dominant periodic signals in the data, such as high-energy motion or illumination noise, rather than the faint, true rPPG signal, leading to poor model generalization. To address this, we propose a new SSL paradigm, Physiological Causal Probing (PCP), which treats the latent rPPG signal as the underlying physical source and the resulting pixel chrominance variations as its visual manifestation. Its core idea is to shift from passive correlation learning to active, precise intervention: it intervenes on the video based on a proposed rPPG hypothesis, and verifies whether the post-intervention changes match physical expectations. We propose the Interv-rPPG framework to implement PCP: an rPPG extractor named PhysMambaFormer hypothesizes the rPPG signal, while a Controllable Physiological Signal Editor conducts precise chrominance-domain interventions on videos based on this hypothesis. Interv-rPPG validates the physical realism of the hypothesis through `Falsifiability via Nulling' and `Axiomatic Equivariance'. Our editor achieves precise editing of the rPPG signal by intervening in the low-frequency chrominance components of the video. Our method improves both in-domain and cross-domain performance on challenging datasets such as VIPL-HR and MMPD. Furthermore, it surpasses the supervised baseline in complex cross-dataset settings, while remaining competitive on clean datasets where the intervention mechanism may introduce slight residual chrominance noise. Extensive experiments, including diagnostic analysis of nuisance sensitivity, demonstrate that the PCP paradigm effectively resists motion and illumination artifacts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。