arXiv:2604.11549cs.HCcs.LG2026-04

用个性化生理信号提升自动驾驶中驾驶员状态识别准确率

Human Centered Non Intrusive Driver State Modeling Using Personalized Physiological Signals in Real World Automated Driving

  • 将生理信号转为图像格式,用预训练模型分析驾驶者状态
  • 个人化模型准确率达92.68%,通用模型仅54%
  • 适合关注自动驾驶安全与个体差异的研究者

在部分或有条件自动驾驶(SAE Level 2-3)车辆中,驾驶员需持续监督系统并响应接管请求,因此可靠的驾驶员监控至关重要。然而,现有系统多依赖忽略个体差异的通用模型。本研究通过在真实道路环境中使用Empatica E4可穿戴设备采集电导率、心率、温度和运动数据,探索非侵入式生理信号用于个性化驾驶员状态建模的可行性。为利用图像深度学习架构,我们将生理信号转化为二维表示,并采用基于预训练ResNet50的多模态模型进行处理。对四名驾驶员的实验显示,不同个体在注意力相关生理模式上存在显著差异。个性化模型平均准确率达92.68%,而跨用户训练的通用模型准确率降至54%,表明跨人泛化能力严重受限。结果强调未来自动驾驶系统需具备自适应个性化的监控能力。

原文摘要 · Abstract (English)

In vehicles with partial or conditional driving automation (SAE Levels 2-3), the driver remains responsible for supervising the system and responding to take-over requests. Therefore, reliable driver monitoring is essential for safe human-automation collaboration. However, most existing Driver Monitoring Systems rely on generalized models that ignore individual physiological variability. In this study, we examine the feasibility of personalized driver state modeling using non-intrusive physiological sensing during real-world automated driving. We conducted experiments in an SAE Level 2 vehicle using an Empatica E4 wearable sensor to capture multimodal physiological signals, including electrodermal activity, heart rate, temperature, and motion data. To leverage deep learning architectures designed for images, we transformed the physiological signals into two-dimensional representations and processed them using a multimodal architecture based on pre-trained ResNet50 feature extractors. Experiments across four drivers demonstrate substantial interindividual variability in physiological patterns related to driver awareness. Personalized models achieved an average accuracy of 92.68%, whereas generalized models trained on multiple users dropped to an accuracy of 54%, revealing substantial limitations in cross-user generalization. These results underscore the necessity of adaptive, personalized driver monitoring systems for future automated vehicles and imply that autonomous systems should adapt to each driver's unique physiological profile.

驾驶员监测个性化建模生理信号自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。