多模态边缘计算框架实现机器人无接触呼吸监测。
Contactless Respiratory Monitoring on Heterogeneous Mobile Robots: A Multimodal Edge-Computing Framework

- 根据光照自动选RGB/热成像/NIR/低光相机
- 8米内可测,低光下黑暗环境仍有效
- 适配四足与轮式机器人,无需重新调参
呼吸率(RR)监测在应急响应、灾后救援和传染病场景中至关重要,减少物理接触可降低救援人员风险。然而,野外部署无接触呼吸监测面临光照变化、体位变动、平台异构及危险环境中穿戴传感器不现实等挑战。本文提出一种面向异构移动机器人的多模态边缘计算无接触呼吸率监测框架。系统融合亮度自适应的传感器选择(包括RGB、热成像、近红外与低光摄像头)、基于关键点的胸廓感兴趣区域提取以应对体位变化,并引入信号质量指数(SQI)过滤机制提升呼吸估计可靠性。在三种涵盖四足与轮式移动平台及多种边缘计算架构的机器人上实现并评估该框架。实验在不同光照、体位和机器人-受试者距离下进行,结果表明该框架可在无需针对每种平台重调算法的情况下跨平台泛化,同时揭示各模态操作边界:RGB可达8米,NIR可达6米,热成像仅短距离可靠,低光传感在完全黑暗中支持长达8米的监测。总体证明了移动机器人上多模态无接触呼吸监测的可行性,为其在危险搜救中用于自主分诊与伤员评估提供了基础。
原文摘要 · Abstract (English)
Respiratory-rate (RR) monitoring is a critical component of remote triage and victim assessment in emergency response, disaster recovery, and infectious-disease scenarios, where minimizing physical contact can reduce responder risk and improve operational safety. However, field deployment of contactless RR monitoring remains challenging due to variable illumination, posture changes, platform heterogeneity, and the impracticality of wearable sensors in hazardous environments. In this paper, we present a modality-adaptive contactless RR monitoring framework for heterogeneous mobile robots with onboard edge computing. The proposed system combines brightness-adaptive sensor selection across RGB, thermal, near-infrared (NIR), and low-light cameras, keypoint-guided chest ROI extraction for posture-robust monitoring, and a signal-quality-index (SQI)-based filtering mechanism for reliable respiratory estimation. We implement and evaluate the framework on three robotic platforms spanning quadruped and wheeled locomotion and multiple edge-computing architectures. Experiments conducted across diverse lighting conditions, subject poses, and robot-to-subject distances demonstrate that the framework generalizes across platforms without per-platform algorithmic retuning, while revealing modality-specific operational boundaries. RGB provides the broadest coverage up to 8m, NIR remains effective up to 6m, thermal is reliable only at short range, and low-light sensing supports monitoring in complete darkness up to 8m. Overall, the results demonstrate the feasibility of multimodal contactless RR monitoring on mobile robots and support its use as a foundation for autonomous triage and victim assessment in hazardous search-and-rescue settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。