arXiv:2607.15995cs.CVcs.LG2026-07中稿 · IJCB 2026

通过归一化面部姿态提升远距离心率检测精度

CanonicalPhys: Pose-Robust Remote Photoplethysmography via Canonical-Space Priors

论文配图:CanonicalPhys: Pose-Robust Remote Photoplethysmography via Canonical-Space Priors
图 1 · 摘自论文原文
  • 引入可微分的四点单应变换,将面部固定到标准坐标系
  • 在大角度偏转下心率误差仅增加1.33倍,优于原有方法
  • 无需额外参数,适合部署于资源受限的医疗设备

深度远距离光体积描记法(rPPG)在正面静止人脸下可实现亚 bpm 心率误差,但在头部姿态变化时性能显著下降:在 MMPD 数据集上,当前最优的 FactorizePhys 骨干网络在大偏航角(|yaw|≥45°)时平均绝对误差(MAE)相比正面(|yaw|<15°)上升了1.60倍。我们指出,姿态是坐标-结构干扰而非数据增强问题——不同姿态下同一像素对应不同解剖位置,破坏了rPPG的三个自然先验:双色反射模型、跨皮肤区域脉搏相位一致性、以及POS/CHROM色度投影。为此提出 CanonicalPhys,通过一个可微分的四点单应变换将四个面部锚点固定于标准位置;在此标准框架中,上述三个先验可表示为每像素兰伯特权重、跨区域时间一致性损失和窗口化POS的知识蒸馏,且不增加骨干网络参数。在相同参数量下,CanonicalPhys 将 MMPD 上正面到大偏航的 MAE 增幅从 1.60× 降至 1.33×,中等偏航(15°≤|yaw|<45°)区间从 1.32× 降至 1.07×,并在多姿态目标上实现最高达32%的跨数据集误差降低。代码开源:https://github.com/infraface/CanonicalPhys

原文摘要 · Abstract (English)

Deep remote photoplethysmography (rPPG) attains sub-bpm heart-rate error on frontal, stationary faces yet degrades sharply under head pose: on MMPD, the state-of-the-art FactorizePhys backbone's MAE grows $1.60\times$ from frontal ($|\text{yaw}|{<}15^\circ$) to large-yaw ($|\text{yaw}|{\geq}45^\circ$) frames. We argue that pose is a \emph{coordinate-structural} nuisance rather than a data-augmentation problem: in image coordinates the same pixel maps to different anatomy at different poses, blocking three priors otherwise natural for rPPG, namely the dichromatic reflection model, pulse-phase invariance across skin regions, and the POS/CHROM chromaticity projection, each of which presumes a stable anatomy-to-pixel mapping. We introduce \textbf{CanonicalPhys}, which prepends a differentiable four-point homography that fixes four facial anchors at canonical positions; in this canonical frame the three priors become expressible as a per-pixel Lambertian weight, a cross-ROI temporal consistency loss, and knowledge distillation from windowed POS, none of which adds trainable parameters over the backbone. At an identical parameter count, CanonicalPhys reduces MMPD's frontal-to-large-yaw MAE degradation from $1.60\times$ to $1.33\times$ and flattens the mild-yaw bin from $1.32\times$ to $1.07\times$ (across CanonicalPhys variants), with matched cross-dataset MAE reductions of up to $32\%$ on pose-rich targets. Code: https://github.com/infraface/CanonicalPhys

rPPG姿态鲁棒医学影像深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。