arXiv:2503.11697cs.LGeess.IV2025-03被引 2

测试了心率估计算法在低光和心跳加快时的表现,发现深度学习方法对光照变化更鲁棒但难测高心率。

Generalization of Video-Based Heart Rate Estimation Methods To Low Illumination and Elevated Heart Rates

  • 对比8种算法在低光和高心率下的表现,涵盖经典信号处理与深度学习方法
  • 新数据集CHILL含45人、4种场景,系统性地改变光照与心率条件
  • 深度学习模型在训练中未覆盖的条件(如高心率)下性能显著下降

心率是反映健康与情绪状态的重要生理信号。远程光电容积脉搏波描记法(rPPG)可通过人脸视频估算该信号。传统rPPG方法依赖信号处理技术,而近年方法采用深度学习网络。现有方法多在光照良好、静息心率条件下评估,对光照变化和心率升高的泛化能力研究不足。本文系统评估了代表性先进rPPG方法在低光照和高心率条件下的表现。我们构建了新数据集CHILL,包含45名参与者在两种光照(高/低)和两种心率(正常/升高)条件下的视频数据,共四个场景。同时选取两个公开数据集进行跨数据集与组内评估。结果表明:经典方法受低光影响较小;部分深度学习方法对光照变化更鲁棒,但在高心率下表现不佳;当训练数据未包含高心率或低光时,深度学习模型泛化能力明显下降。

原文摘要 · Abstract (English)

Heart rate is a physiological signal that provides information about an individual's health and affective state. Remote photoplethysmography (rPPG) allows the estimation of this signal from video recordings of a person's face. Classical rPPG methods make use of signal processing techniques, while recent rPPG methods utilize deep learning networks. Methods are typically evaluated on datasets collected in well-lit environments with participants at resting heart rates. However, little investigation has been done on how well these methods adapt to variations in illumination and heart rate. In this work, we systematically evaluate representative state-of-the-art methods for remote heart rate estimation. Specifically, we evaluate four classical methods and four deep learning-based rPPG estimation methods in terms of their generalization ability to changing scenarios, including low lighting conditions and elevated heart rates. For a thorough evaluation of existing approaches, we collected a novel dataset called CHILL, which systematically varies heart rate and lighting conditions. The dataset consists of recordings from 45 participants in four different scenarios. The video data was collected under two different lighting conditions (high and low) and normal and elevated heart rates. In addition, we selected two public datasets to conduct within- and cross-dataset evaluations of the rPPG methods. Our experimental results indicate that classical methods are not significantly impacted by low-light conditions. Meanwhile, some deep learning methods were found to be more robust to changes in lighting conditions but encountered challenges in estimating high heart rates. The cross-dataset evaluation revealed that the selected deep learning methods underperformed when influencing factors such as elevated heart rates and low lighting conditions were not present in the training set.

rPPG心率估计低光照深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。