arXiv:2506.16160cs.CV2025-06IJCV被引 6

统一解决生理测量的泛化与个性化问题,提升跨场景适应能力。

Align the GAP: Prior-based Unified Multi-Task Remote Physiological Measurement Framework For Domain Generalization and Personalization

  • 通过先验知识分离面部视频中的语义、个体差异和噪声信息。
  • 在六个公开数据集上实现多任务生理测量的泛化与实时个性化,准确率显著提升。
  • 适用于需要自适应调整的可穿戴或车载健康监测场景。

针对多源同构域泛化(MSSDG)在多任务远程生理测量中的应用,旨在提升指标的泛化能力,但部分标注缺失与环境噪声会影响任务精度。同时,为满足个性化产品对实时适应的需求,测试时个性化适配(TTPA)也需研究,然而现有泛化与个性化方法间存在明显鸿沟,难以融合。为此,本文提出一种基于生物特征与远程光电容积脉搏波(rPPG)先验的统一框架(GAP),将面部视频信息解耦为不变语义、个体偏差与噪声。在不同阶段引入先验与观测信息,结合通用与个性化的不同机制,仅做少量调整即可同时实现MSSDG与TTPA。我们在六大数据集上扩展了MSSDG基准至TTPA协议,并引入一个全新真实驾驶场景下的全标注数据集。大量实验验证了该方法的有效性,代码与新数据集将公开发布。

原文摘要 · Abstract (English)

Multi-source synsemantic domain generalization (MSSDG) for multi-task remote physiological measurement seeks to enhance the generalizability of these metrics and attracts increasing attention. However, challenges like partial labeling and environmental noise may disrupt task-specific accuracy. Meanwhile, given that real-time adaptation is necessary for personalized products, the test-time personalized adaptation (TTPA) after MSSDG is also worth exploring, while the gap between previous generalization and personalization methods is significant and hard to fuse. Thus, we proposed a unified framework for MSSD\textbf{G} and TTP\textbf{A} employing \textbf{P}riors (\textbf{GAP}) in biometrics and remote photoplethysmography (rPPG). We first disentangled information from face videos into invariant semantics, individual bias, and noise. Then, multiple modules incorporating priors and our observations were applied in different stages and for different facial information. Then, based on the different principles of achieving generalization and personalization, our framework could simultaneously address MSSDG and TTPA under multi-task remote physiological estimation with minimal adjustments. We expanded the MSSDG benchmark to the TTPA protocol on six publicly available datasets and introduced a new real-world driving dataset with complete labeling. Extensive experiments that validated our approach, and the codes along with the new dataset will be released.

生理测量域泛化个性化rPPG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。