基于自由能原理的智能体中心轨迹预测,提升真实场景下行为合理性。
Agent-Centric Social Trajectory Prediction: A Free Energy Principle Perspective

- 从局部观测出发,用双分支编码器捕捉自身运动与社交交互。
- 通过自由能优化信念分布,在部分可观测下实现更准确的多模态预测。
- 融合社交一致性约束,适合自动驾驶、机器人等需认知合理性的场景。
轨迹预测方法在捕捉复杂运动模式方面表现出色,但现有方法依赖全局状态假设,在部分可观测下信念推断不足,且缺乏认知行为约束,严重影响实际部署可行性与物理合理性。本文提出基于自由能原理的代理中心框架FEP-Diff,旨在实现现实约束下的认知合理预测。具体而言,双分支时空编码器从局部观测中提取自运动动态与社交交互线索;在此基础上,目标条件化信念学习器通过自由能目标优化多模态隐含信念分布,并在局部邻域图上施加社交一致性约束,促进邻近智能体间的认知对齐;最后,基于学习到的信念表示,采用分段扩散生成器进行条件化生成,结合标记级代理条件,输出精确且多样化的未来轨迹。在五个公开基准上的大量实验表明,FEP-Diff在受限观测条件下持续优于当前最优方法。代码:https://anonymous.4open.science/r/FEP-Diff-8876。
原文摘要 · Abstract (English)
Trajectory prediction methods have demonstrated remarkable capabilities in capturing complex motion patterns. However, existing methods rely on global state assumptions, suffer from insufficient belief inference under partial observability, and lack cognitive behavioral constraints in prediction. These limitations severely compromise both deployment feasibility and physical plausibility in real-world settings. In this work, we propose FEP-Diff, an agent-centric trajectory prediction framework grounded in the Free Energy Principle, aimed at achieving cognitively plausible predictions under realistic constraints. Specifically, a dual-branch spatiotemporal encoder extracts ego-motion dynamics and social interaction cues from local observations. Building upon this, a goal-conditioned belief learner infers multimodal latent belief distributions optimized via a free-energy objective, with a social consistency constraint on the local neighborhood graph to promote cognitive alignment among neighboring agents. Finally, a residual diffusion trajectory generator is conditioned on the learned belief representations with token-level proxy conditioning, producing precise and diverse future predictions. Extensive experiments on five public benchmarks demonstrate that FEP-Diff consistently outperforms state-of-the-art methods under restricted observability. Code: https://anonymous.4open.science/r/FEP-Diff-8876.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。