RMP-YOLO通过重建缺失轨迹实现高鲁棒性运动预测。
RMP-YOLO: A Robust Motion Predictor for Partially Observable Scenarios even if You Only Look Once
- 先恢复完整历史轨迹,再进行预测,提升输入可靠性。
- 在Waymo竞赛中获第三,对缺失数据和噪声均保持高精度。
- 可适配现有模型,适合自动驾驶等真实场景应用。
我们提出RMP-YOLO,一种统一框架,可在输入数据不完整时仍提供鲁棒的运动预测。核心思路是:完整可靠的历史轨迹对准确预测至关重要。因此,我们提出新范式——先重建完整历史轨迹,再输入预测模块。该方法引入新颖的场景分块模块,增强时空特征提取与融合;随后,恢复模块利用局部地图拓扑和邻近智能体交互,重构不完整的历史轨迹。重建后的干净轨迹被整合至下游预测模块。该框架能有效处理不同长度的缺失数据,并对观测噪声保持鲁棒,同时维持高预测精度。此外,其恢复模块兼容现有预测模型,实现无缝集成。大量实验验证了方法有效性,实际部署于自动驾驶车辆中也证实其实用性。在2024年Waymo运动预测竞赛中,RMP-YOLO取得领先水平,位列第三。
原文摘要 · Abstract (English)
We introduce RMP-YOLO, a unified framework designed to provide robust motion predictions even with incomplete input data. Our key insight stems from the observation that complete and reliable historical trajectory data plays a pivotal role in ensuring accurate motion prediction. Therefore, we propose a new paradigm that prioritizes the reconstruction of intact historical trajectories before feeding them into the prediction modules. Our approach introduces a novel scene tokenization module to enhance the extraction and fusion of spatial and temporal features. Following this, our proposed recovery module reconstructs agents' incomplete historical trajectories by leveraging local map topology and interactions with nearby agents. The reconstructed, clean historical data is then integrated into the downstream prediction modules. Our framework is able to effectively handle missing data of varying lengths and remains robust against observation noise, while maintaining high prediction accuracy. Furthermore, our recovery module is compatible with existing prediction models, ensuring seamless integration. Extensive experiments validate the effectiveness of our approach, and deployment in real-world autonomous vehicles confirms its practical utility. In the 2024 Waymo Motion Prediction Competition, our method, RMP-YOLO, achieves state-of-the-art performance, securing third place.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。