arXiv:2507.19172cs.AIcs.CV2025-07NeurIPS被引 18

首个面向车载无接触生理监测的大规模多模态数据集,助力驾驶安全研究。

PhysDrive: A Multimodal Remote Physiological Measurement Dataset for In-vehicle Driver Monitoring

  • 采集48名司机的多模态数据,含RGB、红外相机与毫米波雷达信号。
  • 同步标注6项生理指标:心电、血容量、呼吸、心率、呼吸频率和血氧饱和度。
  • 覆盖真实驾驶场景中的动作、光照、车况等复杂因素,适合智能座舱研究。

鲁棒且无侵入式的车载生理监测对保障行车安全与用户体验至关重要。尽管远程生理测量(RPM)提供了有前景的非接触解决方案,但其在真实驾驶场景中的应用受限于高质量数据集的缺乏。现有资源在规模、模态多样性、生物特征标注范围及环境覆盖上均存在不足,难以反映实际驾驶挑战。本文提出PhysDrive,首个面向车内无接触生理感知的大规模多模态数据集,特别考虑多种模态配置与驾驶影响因素。该数据集包含48名驾驶员的同步数据,涵盖RGB、近红外摄像头与原始毫米波雷达信号,并配套六项同步真实值:心电图(ECG)、血容量脉搏(BVP)、呼吸、心率(HR)、呼吸频率(RR)与血氧饱和度(SpO2)。数据覆盖自然驾驶条件下的多种变量,如驾驶员动作、动态自然光照、车型差异与道路状况。我们在PhysDrive上系统评估了信号处理与深度学习方法,建立了跨模态基准,并开源完整代码,兼容主流公共工具箱。我们期待PhysDrive能成为多模态驾驶监控与智能座舱研究的基础资源。

原文摘要 · Abstract (English)

Robust and unobtrusive in-vehicle physiological monitoring is crucial for ensuring driving safety and user experience. While remote physiological measurement (RPM) offers a promising non-invasive solution, its translation to real-world driving scenarios is critically constrained by the scarcity of comprehensive datasets. Existing resources are often limited in scale, modality diversity, the breadth of biometric annotations, and the range of captured conditions, thereby omitting inherent real-world challenges in driving. Here, we present PhysDrive, the first large-scale multimodal dataset for contactless in-vehicle physiological sensing with dedicated consideration on various modality settings and driving factors. PhysDrive collects data from 48 drivers, including synchronized RGB, near-infrared camera, and raw mmWave radar data, accompanied with six synchronized ground truths (ECG, BVP, Respiration, HR, RR, and SpO2). It covers a wide spectrum of naturalistic driving conditions, including driver motions, dynamic natural light, vehicle types, and road conditions. We extensively evaluate both signal-processing and deep-learning methods on PhysDrive, establishing a comprehensive benchmark across all modalities, and release full open-source code with compatibility for mainstream public toolboxes. We envision PhysDrive will serve as a foundational resource and accelerate research on multimodal driver monitoring and smart-cockpit systems.

生理监测多模态车载系统毫米波雷达

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。