用心理特征与融合模型提升行人过街意图预测精度
Pedestrian Crossing Intent Prediction via Psychological Features and Transformer Fusion
- 融合注意力、位置等四类行为流,轻量级设计兼顾效率与性能
- 在PSI 1.0上达0.9 F1、0.94 AUC-ROC,PSI 2.0首次建立基准
- 可量化不确定性,适合资源受限平台的高风险场景应用
行人意图预测对自动驾驶在城市环境中的安全导航至关重要。本文提出一种轻量级、具社会感知能力的行人意图预测架构,通过高速编码器融合四个行为流(注意力、位置、情境、交互),采用紧凑的4令牌Transformer和全局自注意力池化。为量化不确定性,引入两个互补分支:变分瓶颈(其KL散度捕捉认知不确定性)与马氏距离检测器(识别分布偏移)。该设计实现校准概率与可操作的风险评分,同时保持高效。在PSI 1.0基准上,仅使用结构化可解释特征即达到0.9 F1、0.94 AUC-ROC和0.78 MCC,优于近期视觉语言模型。在更具多样性的PSI 2.0数据集上(据我们所知,此前无先例结果),建立初始基线:0.78 F1和0.79 AUC-ROC。基于马氏距离得分的择优预测,在80%覆盖下使测试准确率提升最高达0.4个百分点。定性注意力热图显示,模型在模糊情况下会动态调整跨流关注焦点。该方法具备模态无关性,易于集成至视觉语言流水线,适用于资源受限平台的风险感知意图预测。
原文摘要 · Abstract (English)
Pedestrian intention prediction needs to be accurate for autonomous vehicles to navigate safely in urban environments. We present a lightweight, socially informed architecture for pedestrian intention prediction. It fuses four behavioral streams (attention, position, situation, and interaction) using highway encoders, a compact 4-token Transformer, and global self-attention pooling. To quantify uncertainty, we incorporate two complementary heads: a variational bottleneck whose KL divergence captures epistemic uncertainty, and a Mahalanobis distance detector that identifies distributional shift. Together, these components yield calibrated probabilities and actionable risk scores without compromising efficiency. On the PSI 1.0 benchmark, our model outperforms recent vision language models by achieving 0.9 F1, 0.94 AUC-ROC, and 0.78 MCC by using only structured, interpretable features. On the more diverse PSI 2.0 dataset, where, to the best of our knowledge, no prior results exist, we establish a strong initial baseline of 0.78 F1 and 0.79 AUC-ROC. Selective prediction based on Mahalanobis scores increases test accuracy by up to 0.4 percentage points at 80% coverage. Qualitative attention heatmaps further show how the model shifts its cross-stream focus under ambiguity. The proposed approach is modality-agnostic, easy to integrate with vision language pipelines, and suitable for risk-aware intent prediction on resource-constrained platforms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。