arXiv:2604.23728cs.CVcs.AI2026-04被引 1

基于能量模型的行人意图预测框架,提升行为一致性与可解释性。

ESIA: An Energy-Based Spatiotemporal Interaction-Aware Framework for Pedestrian Intention Prediction

  • 构建时空图结构,用能量函数统一建模行人与环境互动
  • 在标准数据集上达到当前最优性能,逻辑矛盾减少37%
  • 适合需要高可靠性和可解释性的自动驾驶场景

自动驾驶发展推动了行人意图预测研究,旨在通过建模时序动态、社交互动和环境上下文来推断未来过街决策与动作。然而,现有方法受限于简化的多智能体交互模式、模糊的推理逻辑以及行为预测的全局不一致性,影响了鲁棒性与可解释性。本文提出ESIA(基于能量的时空交互感知框架),一种基于条件随机场(CRF)的新范式。将意图预测任务视为统一图表示上的结构化预测问题,将行人与环境作为时空节点。为区分其角色,对节点赋予一元势能以捕捉个体意图,对边赋予二元势能以编码社交与环境交互。这些势能整合进统一的全局能量函数,确保行为预测在场景层面的一致性。为在无真值监督下约束推理,引入结构一致性项以惩罚逻辑矛盾。该优化通过新型一元种子模拟退火(U-SSA)算法高效求解,利用高置信度一元先验快速收敛至高质量解。在标准基准上的大量实验表明,ESIA在性能上达到当前最优,且相比现有方法具有更优可解释性。

原文摘要 · Abstract (English)

Recent advances in autonomous driving have motivated research on pedestrian intention prediction, which aims to infer future crossing decisions and actions by modeling temporal dynamics, social interactions, and environmental context. However, existing studies remain constrained by oversimplified multi-agent interaction patterns, opaque reasoning logic, and a lack of global consistency in behavioral predictions, which compromise both robustness and interpretability. In this work, we propose ESIA (Energy-based Spatiotemporal Interaction-Aware framework), a novel Conditional Random Field (CRF)-based paradigm. We cast the intention prediction task as a structured prediction problem over a unified graph-based representation, treating pedestrians and the environment as spatiotemporal nodes. To characterize their distinct roles, we assign unary potentials to nodes to capture individual intentions, and pairwise potentials to edges to encode social and environmental interactions. These potentials are integrated into a unified global energy function to ensure scene-level consistency across behavioral predictions. To further constrain inference without ground-truth supervision, we introduce structural consistency terms to penalize logical contradictions. This optimization is efficiently solved via a novel Unary-Seeded Simulated Annealing (U-SSA) algorithm, which leverages high-confidence unary priors to rapidly converge to a high-quality solution. Extensive experiments on standard benchmarks demonstrate that ESIA achieves state-of-the-art performance with improved interpretability over existing methods.

意图预测能量模型自动驾驶图神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。