arXiv:2602.12361cs.CV2026-02

用热成像无接触监测心率、呼吸和出汗反应,提升工业人机交互安全。

Thermal Imaging for Contactless Cardiorespiratory and Sudomotor Response Monitoring

论文配图:Thermal Imaging for Contactless Cardiorespiratory and Sudomotor Response Monitoring
图 1 · 摘自论文原文
  • 通过热成像追踪面部区域,分离出汗与呼吸的温度信号。
  • 呼吸率误差3.1 bpm,心率误差13.8 bpm,出汗相关性达0.40。
  • 适合工厂、驾驶舱等需隐私保护的实时状态监控场景。

工业自动化中的人机接口需要感知操作者行为与生理状态。在工厂、车辆、机械舱及人机协作场景中,工作负荷、压力、疲劳或注意力下降会影响安全。可见光监测受限于光照不足、阴影和隐私问题,而热红外成像可在无可见光条件下捕捉皮肤温度动态。本文研究热视频作为无接触计算机视觉模态,用于估计皮电活动(EDA)、心率(HR)和呼吸率(BR),以支持自适应人机接口与操作员状态感知。提出信号处理流程:追踪面部区域,聚合热信号,并分离缓慢的汗腺趋势与快速的心肺成分。采用正交矩阵图像变换(OMIT)在多个面部区域估算心率,利用鼻部与面颊热信号通过谱峰检测估算呼吸率。基于公开的SIMULATOR STUDY 1(SIM1)数据集31次会话,评估288种区域-方法组合,使用滞后容忍指标对比接触式参考。最优固定EDA配置与手掌EDA相关性达0.40±0.23,单次会话最高达0.89。呼吸率估计均方误差3.1±1.1 bpm,心率估计均方误差13.8±7.5 bpm,受限于7.5 Hz热相机帧率。结果表明热视频可提供有效呼吸与汗腺线索,但受区域选择、极性变化、延迟和个体差异影响。研究为热视觉在自适应工业人机界面中的辅助传感层设计提供基准指导。

原文摘要 · Abstract (English)

Human-machine interfaces in industrial automation need sensing modules that monitor operator actions and physiological state. This is important in factories, vehicles, machinery cabins, and human-robot collaboration, where workload, stress, fatigue, or reduced attention can affect safety. RGB monitoring is limited by low light, shadows, and privacy concerns, while thermal infrared imaging captures skin temperature dynamics without visible illumination. This paper studies thermal video as a contactless computer vision modality for estimating electrodermal activity (EDA), heart rate (HR), and breathing rate (BR), with the goal of supporting adaptive human-machine interfaces and operator-state awareness. We propose a signal-processing pipeline that tracks facial regions, aggregates thermal signals, and separates slow sudomotor trends from faster cardiorespiratory components. HR is estimated using orthogonal matrix image transformation (OMIT) across multiple facial regions, while BR is estimated from nasal and cheek thermal signals using spectral peak detection. We characterize 288 ROI-method configurations against contact references with lag-tolerant metrics using 31 sessions from the public SIMULATOR STUDY 1 (SIM1) driver monitoring dataset. The best fixed EDA configuration reaches a mean absolute correlation of $0.40 \pm 0.23$ against palm EDA, with individual sessions reaching $0.89$. BR estimation achieves $3.1 \pm 1.1$\,bpm mean absolute error, while HR estimation yields $13.8 \pm 7.5$\,bpm MAE, limited by the $7.5$\,Hz thermal camera frame rate. The results show that thermal video provides useful respiratory and sudomotor cues, while revealing limitations caused by ROI selection, polarity changes, latency, and subject variability. These findings provide baseline design guidance for thermal computer vision as an auxiliary sensing layer in adaptive industrial HMI systems.

热成像生理监测无接触感知人机交互

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。