提出JAM框架,提升多智能体交互预测中低概率轨迹的生成质量。
JAM: Keypoint-Guided Joint Prediction after Classification-Aware Marginal Proposal for Multi-Agent Interaction
- 分两阶段:先分类预测单个轨迹类型,再联合建模交互关系。
- 在Waymo数据集上优于现有方法,尤其在低概率轨迹生成上表现突出。
- 引入关键点引导,帮助模型捕捉重要轨迹信息,适合自动驾驶研究者。
自动驾驶中预测道路参与者未来运动至关重要。本文针对多智能体联合预测中低概率模式生成质量差的问题,提出名为JAM(Keypoint-Guided Joint Prediction after Classification-Aware Marginal Proposal)的两阶段框架。第一阶段为边缘预测过程,通过轨迹类型分类使模型学习所有轨迹类别,为联合预测模块提供全面的模式信息。第二阶段为联合预测过程,以场景上下文和第一阶段的边缘提案为输入,学习最终联合分布,并显式引入关键路径点,指导联合预测模块更好捕捉并利用初始预测轨迹中的关键信息。在真实世界Waymo Open Motion Dataset交互预测基准上进行大量实验,结果表明该方法性能优异,在框架对比中超越其他方法,达到当前最优水平。代码已开源,便于后续研究。
原文摘要 · Abstract (English)
Predicting the future motion of road participants is a critical task in autonomous driving. In this work, we address the challenge of low-quality generation of low-probability modes in multi-agent joint prediction. To tackle this issue, we propose a two-stage multi-agent interactive prediction framework named \textit{keypoint-guided joint prediction after classification-aware marginal proposal} (JAM). The first stage is modeled as a marginal prediction process, which classifies queries by trajectory type to encourage the model to learn all categories of trajectories, providing comprehensive mode information for the joint prediction module. The second stage is modeled as a joint prediction process, which takes the scene context and the marginal proposals from the first stage as inputs to learn the final joint distribution. We explicitly introduce key waypoints to guide the joint prediction module in better capturing and leveraging the critical information from the initial predicted trajectories. We conduct extensive experiments on the real-world Waymo Open Motion Dataset interactive prediction benchmark. The results show that our approach achieves competitive performance. In particular, in the framework comparison experiments, the proposed JAM outperforms other prediction frameworks and achieves state-of-the-art performance in interactive trajectory prediction. The code is available at https://github.com/LinFunster/JAM to facilitate future research.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。