arXiv:2609.07128cs.AIcs.LG2026-09

用脑电波解码乘客危险感知,提升自动驾驶安全评估。

EEG-Driven Decoding Framework for Passenger Hazard Perception in Highly Automated Vehicles

论文配图:EEG-Driven Decoding Framework for Passenger Hazard Perception in Highly Automated Vehicles
图 1 · 摘自论文原文
  • 构建乘客认知模型,融合3D-CRNN解码脑电信号
  • 风险预测准确率达95.3%,危险识别提升至85.0%
  • 跨会话与跨被试测试仍保持稳定性能,适合真实场景应用

可靠的危险评估仍是自动驾驶的核心挑战。尽管自动化水平提升,乘客认知可作为无侵入性辅助信号,提升客观与主观安全性,且无需主动干预。本文提出基于脑电图(EEG)的脑机接口,用于解码乘客神经响应以实现风险预测(RP)和危险识别(DI),明确将人类作为乘客建模以匹配真实自动驾驶使用场景。为此,提出乘客认知模型(PCM)、风险感知序列标注(RSL)及乘客脑电解码策略(PEDS),整合3D卷积循环神经网络(3D-CRNN)进行联合解码。实验表明,3D-CRNN在风险预测中达到95.3% ± 2.7%的平衡准确率,单被试危险识别从80.9% ± 3.9%提升至85.0% ± 3.2%。事件级分析显示,3D-CRNN在各类事件中均优于其他模型。泛化实验中,跨会话危险识别达77.0% ± 5.3%,同被试跨被试评估达77.4% ± 1.1%,未见被试仍保持64.9% ± 8.5%的准确率,展现出良好的泛化与迁移能力。研究建立了基于EEG的乘客危险感知解码框架,表明乘客认知信号可为未来自动驾驶决策与功能安全(SOTIF)提供辅助监督。

原文摘要 · Abstract (English)

Reliable risk assessment remains a central challenge for Autonomous Vehicles (AVs). Despite advances in automation, passenger cognition provides a non-intrusive auxiliary signal that improves both objective and perceived safety without requiring active human intervention. We introduce an Electroencephalogram (EEG)-based Brain-Computer Interface (BCI) that decodes passenger neural responses for both Risk Prediction (RP) and Danger Identification (DI), explicitly modeling humans as passengers to match real-world AV use. To achieve this, we propose the Passenger Cognitive Model (PCM), Risk-aware Sequential Labeling (RSL), and the Passenger EEG Decoding Strategy (PEDS), which integrates a 3D Convolutional Recurrent Neural Network (3D-CRNN) model for joint EEG decoding. Experimental results show that 3D-CRNN achieves a Balanced Accuracy (BA) of $95.3\% \pm 2.7\%$ in RP and improves single-subject DI from $80.9\% \pm 3.9\%$ to $85.0\% \pm 3.2\%$ with RSL. Event-wise analyses further show that 3D-CRNN consistently outperforms other models across different event types in RP and DI. In generalization experiments, 3D-CRNN achieves $77.0\% \pm 5.3\%$ BA in cross-session DI and $77.4\% \pm 1.1\%$ BA on seen subjects in cross-subject evaluation, while maintaining a $64.9\% \pm 8.5\%$ BA on unseen subjects, demonstrating promising generalizability and transferability across both intra-subject and inter-subject variability. These findings establish an Electroencephalogram (EEG) decoding framework for AV passenger hazard perception and suggest that passenger cognitive signals can provide auxiliary supervision for future AV decision-making and Safety of the Intended Functionality (SOTIF) support.

脑机接口自动驾驶风险感知脑电解码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。