arXiv:2509.04490cs.CV2025-09

人脸情绪识别无法准确反映自动驾驶中的安全感缺失。

Facial Emotion Recognition does not detect feeling unsafe in automated driving

  • 用车辆运动和皮肤电反应构建神经网络预测风险感知。
  • 24人中仅9人有面部反应,且多为高兴而非恐惧。
  • 适合关注自动驾驶人机信任与客观评估的研究者。

信任与感知安全对自动驾驶公众接受度至关重要。通过驾驶模拟器实验,收集32名参与者在两种自动化驾驶风格下、含或不含横穿行人的场景数据,包括主观舒适度评分、运动数据、面部视频、皮肤电导、心率及眼动追踪。结果显示,转弯和急刹时感知风险显著上升,随后出现缓解甚至积极感受。动态驾驶风格比平稳风格引发更强不适;行人横穿对动态风格的舒适度影响翻倍,而对平稳风格无显著影响,凸显关键交互后果的重要性。24名参与者中面部表情成功分析,但多数(15/24)未对关键事件产生可检测面部反应,其中9人中有8人呈现快乐表情,仅4人显示惊讶,恐惧从未主导。表明面部情绪识别难以有效评估自动驾驶中的感知风险。基于车辆运动与皮肤电导的神经网络模型与主观报告高度相关,具备客观评估感知风险潜力,减少主观偏差,并为未来研究指明方向。

原文摘要 · Abstract (English)

Trust and perceived safety play a crucial role in the public acceptance of automated vehicles. To understand perceived risk, an experiment was conducted using a driving simulator under two automated driving styles and optionally introducing a crossing pedestrian. Data was collected from 32 participants, consisting of continuous subjective comfort ratings, motion, webcam footage for facial expression, skin conductance, heart rate, and eye tracking. The continuous subjective perceived risk ratings showed significant discomfort associated with perceived risk during cornering and braking followed by relief or even positive comfort on continuing the ride. The dynamic driving style induced a stronger discomfort as compared to the calm driving style. The crossing pedestrian did not affect discomfort with the calm driving style but doubled the comfort decrement with the dynamic driving style. This illustrates the importance of consequences of critical interactions in risk perception. Facial expression was successfully analyzed for 24 participants but most (15/24) did not show any detectable facial reaction to the critical event. Among the 9 participants who did, 8 showed a Happy expression, and only 4 showed a Surprise expression. Fear was never dominant. This indicates that facial expression recognition is not a reliable method for assessing perceived risk in automated vehicles. To predict perceived risk a neural network model was implemented using vehicle motion and skin conductance. The model correlated well with reported perceived risk, demonstrating its potential for objective perceived risk assessment in automated vehicles, reducing subjective bias and highlighting areas for future research.

自动驾驶情绪识别感知风险神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。