arXiv:2603.22826cs.CV2026-03被引 2

解决遮挡下多视角远程心率检测难题,提出新数据集与鲁棒算法。

MVRD-Bench: Multi-View Learning and Benchmarking for Dynamic Remote Photoplethysmography under Occlusion

  • 设计多视角融合框架,自适应补偿运动伪影并分离心跳与外观特征。
  • 在移动遮挡场景下达到0.90的平均绝对误差和0.99的皮尔逊相关系数。
  • 适合做非接触生理信号监测、智能健康设备研发的研究者参考。

远程光电容积脉搏波描记术(rPPG)是一种通过分析面部视频中细微肤色变化来估计生理信号的非接触技术。现有方法在面部运动或遮挡情况下性能下降,因其依赖静态单视角视频。为此,本文针对非约束多视角视频中的运动诱导遮挡问题,构建了高质量的多视角rPPG数据集MVRD,包含三个视角在静止、说话及头部运动场景下的同步面部视频,更贴近真实应用环境。提出统一的MVRD-rPPG多视角学习框架,融合互补视觉线索以保持运动条件下的皮肤覆盖。该方法集成自适应时序光流补偿模块(ATOC)抑制运动伪影,节奏-视觉双流网络解耦周期性与外观特征,并引入多视角相关性感知注意力(MVCA)实现自适应视图级信号聚合。此外,提出相关频率对抗学习策略(CFA),联合优化预测信号的时间准确性、频谱一致性和感知真实性。在MVRD数据集上的大量实验与消融研究验证了方法优越性:在移动场景下,平均绝对误差(MAE)为0.90,皮尔逊相关系数(R)达0.99。代码与数据集将公开。

原文摘要 · Abstract (English)

Remote photoplethysmography (rPPG) is a non-contact technique that estimates physiological signals by analyzing subtle skin color changes in facial videos. Existing rPPG methods often encounter performance degradation under facial motion and occlusion scenarios due to their reliance on static and single-view facial videos. Thus, this work focuses on tackling the motion-induced occlusion problem for rPPG measurement in unconstrained multi-view facial videos. Specifically, we introduce a Multi-View rPPG Dataset (MVRD), a high-quality benchmark dataset featuring synchronized facial videos from three viewpoints under stationary, speaking, and head movement scenarios to better match real-world conditions. We also propose MVRD-rPPG, a unified multi-view rPPG learning framework that fuses complementary visual cues to maintain robust facial skin coverage, especially under motion conditions. Our method integrates an Adaptive Temporal Optical Compensation (ATOC) module for motion artifact suppression, a Rhythm-Visual Dual-Stream Network to disentangle rhythmic and appearance-related features, and a Multi-View Correlation-Aware Attention (MVCA) for adaptive view-wise signal aggregation. Furthermore, we introduce a Correlation Frequency Adversarial (CFA) learning strategy, which jointly enforces temporal accuracy, spectral consistency, and perceptual realism in the predicted signals. Extensive experiments and ablation studies on the MVRD dataset demonstrate the superiority of our approach. In the MVRD movement scenario, MVRD-rPPG achieves an MAE of 0.90 and a Pearson correlation coefficient (R) of 0.99. The source code and dataset will be made available.

rPPG多视角遮挡处理生理监测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。