arXiv:2604.07651cs.LGcs.AI2026-04

让自动驾驶感知理解驾驶员心理状态,提升行为预测准确率。

Cognitive-Causal Multi-Task Learning with Psychological State Conditioning for Assistive Driving Perception

论文配图:Cognitive-Causal Multi-Task Learning with Psychological State Conditioning for Assistive Driving Perception
图 1 · 摘自论文原文
  • 构建认知因果链,逐层传递任务预测结果
  • 用驾驶员表情姿态推断心理状态,统一调节各任务
  • 仅505万参数,驾驶情绪与行为识别显著提升

面向高级驾驶辅助系统,多任务学习需建模驾驶员内在状态与外部交通环境的复杂交互。现有方法将识别任务视为独立目标,忽视驾驶行为背后的认知因果结构。本文提出基于认知科学的因果多任务学习框架CauPsi,显式建模交通上下文识别(TCR)、车辆上下文识别(VCR)、驾驶员情绪识别(DER)和驾驶员行为识别(DBR)之间的层次依赖关系。提出两个关键机制:一是通过可学习原型嵌入实现任务间的因果链传播,以可微方式模拟从环境感知到行为调控的认知级联;二是跨任务心理状态条件化(CTPC),从驾驶员面部表情和体态估计心理状态信号,并作为条件输入注入所有任务,建模内部状态对认知与决策的调节作用。在AIDE数据集上,CauPsi以仅5.05M参数达到82.71%平均准确率,整体优于前序工作1.0%,其中DER提升3.65%,DBR提升7.53%。消融实验验证各组件独立贡献,心理状态信号分析表明其能自监督地捕获与任务标签相关的系统性模式,无需显式心理标注。

原文摘要 · Abstract (English)

Multi-task learning for advanced driver assistance systems requires modeling the complex interplay between driver internal states and external traffic environments. However, existing methods treat recognition tasks as flat and independent objectives, failing to exploit the cognitive causal structure underlying driving behavior. In this paper, we propose CauPsi, a cognitive science-grounded causal multi-task learning framework that explicitly models the hierarchical dependencies among Traffic Context Recognition (TCR), Vehicle Context Recognition (VCR), Driver Emotion Recognition (DER), and Driver Behavior Recognition (DBR). The proposed framework introduces two key mechanisms. First, a Causal Task Chain propagates upstream task predictions to downstream tasks via learnable prototype embeddings, realizing the cognitive cascade from environmental perception to behavioral regulation in a differentiable manner. Second, Cross-Task Psychological Conditioning (CTPC) estimates a psychological state signal from driver facial expressions and body posture and injects it as a conditioning input to all tasks including environmental recognition, thereby modeling the modulatory effect of driver internal states on cognitive and decision-making processes. Evaluated on the AIDE dataset, CauPsi achieves a mean accuracy of 82.71% with only 5.05M parameters, surpassing prior work by +1.0% overall, with notable improvements on DER (+3.65%) and DBR (+7.53%). Ablation studies validate the independent contribution of each component, and analysis of the psychological state signal confirms that it acquires systematic task-label-dependent patterns in a self-supervised manner without explicit psychological annotations.

多任务学习驾驶辅助心理状态建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。