arXiv:2507.07908cs.CV2025-07被引 4

利用生理信号时空不一致性提升远程生命体征测量的实时自适应能力

Not Only Consistency: Enhance Test-Time Adaptation with Spatio-temporal Inconsistency for Remote Physiological Measurement

  • 基于生理先验,融合时空一致性与不一致性的自监督学习框架
  • 在五个数据集上实现当前最佳的测试时自适应性能
  • 适合需要隐私保护和实时部署的生命体征监测场景

远程生理测量(RPM)作为一种非接触式监测方法,近年来备受关注。尽管已有多种域自适应与泛化方法用于提升深度模型在未知环境中的适应性,但隐私顾虑与实时适应限制了其实际应用。为此,本文提出一种全新的完全测试时自适应(TTA)策略,专为RPM任务设计。基于生理学先验与观察,我们发现:虽然心率波形(BVP)在频域存在时空一致性,但在时域中不一致性同样显著。因此,我们引入一种基于专家知识的自监督框架——一致性-不一致性整合(CiCi),同时利用一致性和不一致性先验来增强推理阶段的模型适应能力。此外,通过梯度动态控制机制缓解先验间的潜在冲突,确保跨实例的稳定适应。在五个不同数据集上采用TTA协议的大量实验表明,本方法持续优于现有技术,在无需访问源数据的情况下实现了最先进的实时自监督适应性能。

原文摘要 · Abstract (English)

Remote physiological measurement (RPM) has emerged as a promising non-invasive method for monitoring physiological signals using the non-contact device. Although various domain adaptation and generalization methods were proposed to promote the adaptability of deep-based RPM models in unseen deployment environments, considerations in aspects such as privacy concerns and real-time adaptation restrict their application in real-world deployment. Thus, we aim to propose a novel fully Test-Time Adaptation (TTA) strategy tailored for RPM tasks in this work. Specifically, based on prior knowledge in physiology and our observations, we noticed not only there is spatio-temporal consistency in the frequency domain of BVP signals, but also that inconsistency in the time domain was significant. Given this, by leveraging both consistency and inconsistency priors, we introduce an innovative expert knowledge-based self-supervised \textbf{C}onsistency-\textbf{i}n\textbf{C}onsistency-\textbf{i}ntegration (\textbf{CiCi}) framework to enhances model adaptation during inference. Besides, our approach further incorporates a gradient dynamic control mechanism to mitigate potential conflicts between priors, ensuring stable adaptation across instances. Through extensive experiments on five diverse datasets under the TTA protocol, our method consistently outperforms existing techniques, presenting state-of-the-art performance in real-time self-supervised adaptation without accessing source data. The code will be released later.

远程测量测试时适应自监督学习生理信号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。