用蝴蝶结构提升远距离心率检测精度
BTS-rPPG: Orthogonal Butterfly Temporal Shifting for Remote Photoplethysmography
- 基于异或配对的蝴蝶时序移位,扩大时间感知范围
- 引入正交特征传递,减少冗余信息传播
- 在多个数据集上优于现有方法,适合动态信号建模
远程光电容积脉搏波图(rPPG)通过分析面部视频中由血液循环引起的细微外观变化,实现无接触生理传感。然而,建模这些信号的时间动态仍具挑战性,因许多深度学习方法依赖于仅聚合邻近帧信息的时序移位或卷积算子,导致主要为局部时序建模且时序感受野有限。为解决此问题,我们提出BTS-rPPG,一种基于正交蝴蝶时序移位(BTS)的时序建模框架。受快速傅里叶变换(FFT)中蝴蝶通信模式启发,BTS通过异或(XOR)基蝴蝶配对调度建立结构化帧间交互,逐步扩展时序感受野,实现远距离帧间信息高效传播。此外,我们引入正交特征传输机制(OFT),在时序移位前根据目标上下文过滤源特征,仅保留正交分量进行跨帧传输,减少冗余传播并促进互补时序交互。在多个基准数据集上的大量实验表明,BTS-rPPG显著提升了生理动态的长程时序建模能力,并持续优于现有时序建模策略。
原文摘要 · Abstract (English)
Remote photoplethysmography (rPPG) enables contactless physiological sensing from facial videos by analyzing subtle appearance variations induced by blood circulation. However, modeling the temporal dynamics of these signals remains challenging, as many deep learning methods rely on temporal shifting or convolutional operators that aggregate information primarily from neighboring frames, resulting in predominantly local temporal modeling and limited temporal receptive fields. To address this limitation, we propose BTS-rPPG, a temporal modeling framework based on Orthogonal Butterfly Temporal Shifting (BTS). Inspired by the butterfly communication pattern in the Fast Fourier Transform (FFT), BTS establishes structured frame interactions via an XOR-based butterfly pairing schedule, progressively expanding the temporal receptive field and enabling efficient propagation of information across distant frames. Furthermore, we introduce an orthogonal feature transfer mechanism (OFT) that filters the source feature with respect to the target context before temporal shifting, retaining only the orthogonal component for cross-frame transmission. This reduces redundant feature propagation and encourages complementary temporal interaction. Extensive experiments on multiple benchmark datasets demonstrate that BTS-rPPG improves long-range temporal modeling of physiological dynamics and consistently outperforms existing temporal modeling strategies for rPPG estimation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。