RealTraj通过合成数据预训练+少量真实数据微调,降低标注成本并提升轨迹预测鲁棒性。
RealTraj: Towards Real-World Pedestrian Trajectory Forecasting
- 用合成数据预训练+检测框微调,减少对真实身份标注的依赖
- 提出Det2TrajFormer模型,基于历史检测框预测轨迹,抗跟踪噪声
- 在多个数据集上优于现有方法,适合实际场景部署
本文协同解决传统行人轨迹预测中的三大局限:行人感知误差、真实世界数据收集成本高以及人员身份标注成本高。我们提出新框架RealTraj,提升轨迹预测在真实场景下的适用性。该方法包含两个训练阶段——在合成数据上进行自监督预训练,以及在有限真实数据上进行弱监督微调,以最小化数据采集工作量。为增强对真实世界误差的鲁棒性,我们在模型设计和训练目标上均进行优化。具体地,提出Det2TrajFormer模型,利用历史检测框作为输入,使模型对跟踪噪声保持不变。此外,通过多种预训练任务增强模型鲁棒性,并仅依赖检测数据实现性能提升。与以往方法不同,本方法仅使用真实检测框进行微调,无需昂贵的身份标注。实验表明,所提方法有效克服上述局限,在多个数据集上超越现有先进方法。代码将发布于 https://fujiry0.github.io/RealTraj-project-page。
原文摘要 · Abstract (English)
This paper jointly addresses three key limitations in conventional pedestrian trajectory forecasting: pedestrian perception errors, real-world data collection costs, and person ID annotation costs. We propose a novel framework, RealTraj, that enhances the real-world applicability of trajectory forecasting. Our approach includes two training phases -- self-supervised pretraining on synthetic data and weakly-supervised fine-tuning with limited real-world data -- to minimize data collection efforts. To improve robustness to real-world errors, we focus on both model design and training objectives. Specifically, we present Det2TrajFormer, a trajectory forecasting model that remains invariant to tracking noise by using past detections as inputs. Additionally, we pretrain the model using multiple pretext tasks, which enhance robustness and improve forecasting performance based solely on detection data. Unlike previous trajectory forecasting methods, our approach fine-tunes the model using only ground-truth detections, reducing the need for costly person ID annotations. In the experiments, we comprehensively verify the effectiveness of the proposed method against the limitations, and the method outperforms state-of-the-art trajectory forecasting methods on multiple datasets. The code will be released at https://fujiry0.github.io/RealTraj-project-page.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。