arXiv:2607.06319cs.CV2026-07被引 1

用合成数据训练运动预测,解决真实数据标注贵的问题。

Synthetic-to-Real Translation for Class-Agnostic Motion Prediction

论文配图:Synthetic-to-Real Translation for Class-Agnostic Motion Prediction
图 1 · 摘自论文原文
  • 通过物体存在性感知预测,学习跨域不变特征。
  • 利用物体存在性先验过滤噪声,提升真实场景预测精度。
  • 首次构建面向该任务的4D LiDAR合成数据集,支持研究推进。

运动理解对自动驾驶系统的安全与鲁棒性至关重要,推动了运动预测的研究兴趣。该领域关键挑战在于真实世界运动标签获取成本高昂。因此,将合成数据中的运动知识迁移到真实数据中极具价值。本文探索合成到真实运动预测(SRMP)的潜力。然而,主流的朴素运动回归方法对合成到真实的域偏移极为敏感,导致知识迁移不可靠。为此,我们提出一种新方法,融合两个核心组件:(1) 物体存在性感知运动预测,显式建模运动模式与物体存在性先验的联合分布,以增强域不变特征学习;(2) 物体存在性辅助运动增强,一种利用学习到的物体存在性先验来过滤运动噪声的标签优化机制。此外,我们提出了一个基于物理的流水线,生成首个专为SRMP研究设计的合成4D LiDAR数据集Motion4D,弥补了合成运动数据集的缺失。实验结果表明,该方法有效弥合了域间差距,在真实场景中表现优异。

原文摘要 · Abstract (English)

Motion understanding is critical for ensuring safety and robustness in autonomous driving systems, driving increasing interest in motion prediction. A key challenge in this domain is the high cost associated with acquiring real-world motion labels. It is therefore ideal if we could transfer motion knowledge from synthetic data to real data. In this context, we explore the potential of synthetic-to-real translation for motion prediction (SRMP). However, the most used naive motion regression methods are notably sensitive to the synthetic-to-real domain shift, resulting in unreliable knowledge translation. To address this, we propose a novel approach integrating a motion knowledge translation framework with two key components: (1) objectness-aware motion prediction, which explicitly models the joint distribution of motion patterns and objectness priors to improve domain-invariant feature learning, and (2) objectness-aided motion enhancement, a motion label refinement mechanism that leverages learned objectness priors to filter motion noise. Furthermore, we present a physically-based pipeline for generating Motion4D, the first synthetic 4D LiDAR dataset tailored for SRMP research, addressing the lack of synthetic motion datasets. Experimental results demonstrate that our approach effectively bridges the domain gaps and yields superior performance on real scenes.

运动预测域迁移合成数据LiDAR

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。