arXiv:2410.12195cs.CVcs.AI2024-10

提出可解释的行人行为预测模型,同时预测动作、轨迹和姿态。

Sparse Prototype Network for Explainable Pedestrian Behavior Prediction

  • 用原型瓶颈层提取跨模态的可解释特征
  • 在TITAN和PIE数据集上达到领先性能
  • 适合需要透明决策的自动驾驶场景

行人行为预测对自动驾驶和智慧城市至关重要。尽管深度学习模型在准确率上表现优异,但缺乏可解释性,尤其在多模态输入下问题更突出。为此,我们提出稀疏原型网络(SPN),能同时预测行人的未来动作、轨迹和姿态。SPN通过中间原型瓶颈层提供基于样本的解释,原型具有模态无关性,可适配任意输入组合。在单语义性和聚类约束正则化下,原型学习到一致且人类可理解的特征,在TITAN和PIE数据集上实现动作、轨迹和姿态预测的最新性能。我们还提出Top-K单语义性量表,定量评估可解释性。定性结果表明稀疏性与可解释性正相关。代码已开源。

原文摘要 · Abstract (English)

Predicting pedestrian behavior is challenging yet crucial for applications such as autonomous driving and smart city. Recent deep learning models have achieved remarkable performance in making accurate predictions, but they fail to provide explanations of their inner workings. One reason for this problem is the multi-modal inputs. To bridge this gap, we present Sparse Prototype Network (SPN), an explainable method designed to simultaneously predict a pedestrian's future action, trajectory, and pose. SPN leverages an intermediate prototype bottleneck layer to provide sample-based explanations for its predictions. The prototypes are modality-independent, meaning that they can correspond to any modality from the input. Therefore, SPN can extend to arbitrary combinations of modalities. Regularized by mono-semanticity and clustering constraints, the prototypes learn consistent and human-understandable features and achieve state-of-the-art performance on action, trajectory and pose prediction on TITAN and PIE. Finally, we propose a metric named Top-K Mono-semanticity Scale to quantitatively evaluate the explainability. Qualitative results show the positive correlation between sparsity and explainability. Code available at https://github.com/Equinoxxxxx/SPN.

可解释性行为预测原型网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。