arXiv:2501.04815cs.CV2025-01CVPR被引 9

提出PerReg+框架,提升车辆轨迹预测的泛化能力与准确性。

Towards Generalizable Trajectory Prediction Using Dual-Level Representation Learning And Adaptive Prompting

  • 双层表征学习融合自蒸馏与掩码重建,捕捉全局与细节信息。
  • 预训练注册查询增强多模态处理,跨数据集误差降低11.8%。
  • 自适应提示调优实现高效微调,适合快速适配新场景。

现有车辆轨迹预测模型在泛化能力、预测不确定性及复杂交互处理方面表现不佳,常因针对特定数据集设计的复杂架构和低效的多模态处理所致。本文提出Perceiver with Register queries(PerReg+),引入三项创新:(1) 双层表征学习通过自蒸馏(SD)与掩码重建(MR),从遮蔽输入中重构路段级轨迹与车道线,有效利用上下文信息并提升泛化性;(2) 基于注册查询的多模态增强策略,无需聚类与抑制即可高效处理多源数据;(3) 微调阶段采用自适应提示调优,冻结主干网络仅优化少量提示参数,实现高效适应。PerReg+在nuScenes [1]、Argoverse 2 [2] 和 Waymo Open Motion Dataset (WOMD) [3] 上达到新最优性能。值得注意的是,预训练模型在小规模数据集上误差降低6.8%,多数据集训练显著提升泛化能力;跨域测试中,相较于非预训练版本,B-FDE降低11.8%。

原文摘要 · Abstract (English)

Existing vehicle trajectory prediction models struggle with generalizability, prediction uncertainties, and handling complex interactions. It is often due to limitations like complex architectures customized for a specific dataset and inefficient multimodal handling. We propose Perceiver with Register queries (PerReg+), a novel trajectory prediction framework that introduces: (1) Dual-Level Representation Learning via Self-Distillation (SD) and Masked Reconstruction (MR), capturing global context and fine-grained details. Additionally, our approach of reconstructing segmentlevel trajectories and lane segments from masked inputs with query drop, enables effective use of contextual information and improves generalization; (2) Enhanced Multimodality using register-based queries and pretraining, eliminating the need for clustering and suppression; and (3) Adaptive Prompt Tuning during fine-tuning, freezing the main architecture and optimizing a small number of prompts for efficient adaptation. PerReg+ sets a new state-of-the-art performance on nuScenes [1], Argoverse 2 [2], and Waymo Open Motion Dataset (WOMD) [3]. Remarkable, our pretrained model reduces the error by 6.8% on smaller datasets, and multi-dataset training enhances generalization. In cross-domain tests, PerReg+ reduces B-FDE by 11.8% compared to its non-pretrained variant.

轨迹预测多模态预训练自适应提示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。