用自适应伪标签和一致性正则化,让少量标注数据也能训练出更精准的远程生理信号检测模型。
Semi-rPPG: Semi-Supervised Remote Physiological Measurement with Curriculum Pseudo-Labeling
- 基于信噪比筛选伪标签,自动过滤低质量无标签数据。
- 在四个公开数据集上性能超越经典半监督方法,跨数据集测试提升显著。
- 适合做远程健康监测、弱标注场景下生理信号建模的研究者使用。
远程光电容积脉搏波描记(rPPG)可从人脸视频中无接触监测心率等生理信号,但标注视频难以获取。现有研究多依赖小规模、环境简单的公开数据集,限制了模型泛化能力。本文提出一种新型半监督学习方法Semi-rPPG,结合课程式伪标签与一致性正则化,从大量无标签数据中提取内在生理特征,同时抑制噪声干扰。具体而言,提出基于信噪比(SNR)的课程伪标签策略,动态筛选高质量无标签样本;设计针对准周期信号的增强一致性正则项,利用弱增强与强增强片段进行约束。为推动半监督rPPG研究,构建了包含跨数据集与同数据集评估的新基准。实验表明,Semi-rPPG在多种协议下优于三种经典半监督方法,消融实验验证了各模块有效性。
原文摘要 · Abstract (English)
Remote Photoplethysmography (rPPG) is a promising technique to monitor physiological signals such as heart rate from facial videos. However, the labeled facial videos in this research are challenging to collect. Current rPPG research is mainly based on several small public datasets collected in simple environments, which limits the generalization and scale of the AI models. Semi-supervised methods that leverage a small amount of labeled data and abundant unlabeled data can fill this gap for rPPG learning. In this study, a novel semi-supervised learning method named Semi-rPPG that combines curriculum pseudo-labeling and consistency regularization is proposed to extract intrinsic physiological features from unlabelled data without impairing the model from noises. Specifically, a curriculum pseudo-labeling strategy with signal-to-noise ratio (SNR) criteria is proposed to annotate the unlabelled data while adaptively filtering out the low-quality unlabelled data. Besides, a novel consistency regularization term for quasi-periodic signals is proposed through weak and strong augmented clips. To benefit the research on semi-supervised rPPG measurement, we establish a novel semi-supervised benchmark for rPPG learning through intra-dataset and cross-dataset evaluation on four public datasets. The proposed Semi-rPPG method achieves the best results compared with three classical semi-supervised methods under different protocols. Ablation studies are conducted to prove the effectiveness of the proposed methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。