用对比学习生成短轨迹轻量嵌入,兼顾精度与效率。
Contrast & Compress: Learning Lightweight Embeddings for Short Trajectories
- 用变压器架构加对比三元组损失学习固定维度嵌入。
- 16维嵌入在Argoverse 2上达到更优检索性能(minADE, minFDE)。
- 支持低维嵌入(甚至4维),适合实时系统部署。
准确高效地检索语义和方向相似的短程轨迹,是运动预测与自动驾驶等下游任务的基础。现有方法常依赖计算量大且不可解释的启发式规则或潜在锚点表示。本文提出一种新框架,通过在变换器编码器上使用对比三元组损失,学习短轨迹的固定维度嵌入,强调判别性特征空间的重要性。我们分析了余弦相似度与基于FFT的相似度度量在对比学习中的影响,重点捕捉短期机动中的细微方向意图。在Argoverse 2数据集上的实证评估表明,采用余弦相似度目标的嵌入在语义和方向属性上实现更优聚类效果,优于基于FFT的基线。值得注意的是,即使使用低维嵌入(如16维,甚至低至4维),紧凑型变换器仍能实现检索性能(minADE, minFDE)与计算开销间的良好平衡,契合实时系统对可扩展、可解释运动先验的需求。所得嵌入具有紧凑、语义明确、高效的特点,为启发式相似度度量提供了可靠替代方案,推动更透明可控的运动预测流程发展。
原文摘要 · Abstract (English)
The ability to retrieve semantically and directionally similar short-range trajectories with both accuracy and efficiency is foundational for downstream applications such as motion forecasting and autonomous navigation. However, prevailing approaches often depend on computationally intensive heuristics or latent anchor representations that lack interpretability and controllability. In this work, we propose a novel framework for learning fixed-dimensional embeddings for short trajectories by leveraging a Transformer encoder trained with a contrastive triplet loss that emphasize the importance of discriminative feature spaces for trajectory data. We analyze the influence of Cosine and FFT-based similarity metrics within the contrastive learning paradigm, with a focus on capturing the nuanced directional intent that characterizes short-term maneuvers. Our empirical evaluation on the Argoverse 2 dataset demonstrates that embeddings shaped by Cosine similarity objectives yield superior clustering of trajectories by both semantic and directional attributes, outperforming FFT-based baselines in retrieval tasks. Notably, we show that compact Transformer architectures, even with low-dimensional embeddings (e.g., 16 dimensions, but qualitatively down to 4), achieve a compelling balance between retrieval performance (minADE, minFDE) and computational overhead, aligning with the growing demand for scalable and interpretable motion priors in real-time systems. The resulting embeddings provide a compact, semantically meaningful, and efficient representation of trajectory data, offering a robust alternative to heuristic similarity measures and paving the way for more transparent and controllable motion forecasting pipelines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。