arXiv:2410.14629cs.LGcs.DB2024-10被引 14

单层Transformer提升轨迹相似性计算效率与准确率

SIMformer: Single-Layer Vanilla Transformer Can Learn Free-Space Trajectory Similarity

  • 仅用单层纯Transformer编码器提取轨迹特征
  • 相比传统方法,显著缓解维度灾难问题,精度更高
  • 适合大规模轨迹数据的高效相似性搜索任务

自由空间轨迹相似性计算(如DTW、Hausdorff、Frechet)通常具有二次时间复杂度。现有学习方法通过训练编码器将轨迹映射为向量表示,再计算向量相似性以近似真实相似性。然而,这些方法存在双重挑战:1)普遍使用欧氏距离计算表示相似性,导致维度灾难,降低表示可区分性,严重影响相似性搜索精度;2)多数采用三元组训练方式,需额外信息,降低效率;3)虽强调效率可扩展性,但忽视数据集增大时性能下降问题。为此,本文提出SIMformer,仅使用单层纯Transformer编码器作为特征提取器,并设计定制化表示相似性函数,以逼近多种真实相似性度量。大量实验表明,该模型显著缓解维度灾难问题,在有效性、效率和可扩展性上均优于现有方法。

原文摘要 · Abstract (English)

Free-space trajectory similarity calculation, e.g., DTW, Hausdorff, and Frechet, often incur quadratic time complexity, thus learning-based methods have been proposed to accelerate the computation. The core idea is to train an encoder to transform trajectories into representation vectors and then compute vector similarity to approximate the ground truth. However, existing methods face dual challenges of effectiveness and efficiency: 1) they all utilize Euclidean distance to compute representation similarity, which leads to the severe curse of dimensionality issue -- reducing the distinguishability among representations and significantly affecting the accuracy of subsequent similarity search tasks; 2) most of them are trained in triplets manner and often necessitate additional information which downgrades the efficiency; 3) previous studies, while emphasizing the scalability in terms of efficiency, overlooked the deterioration of effectiveness when the dataset size grows. To cope with these issues, we propose a simple, yet accurate, fast, scalable model that only uses a single-layer vanilla transformer encoder as the feature extractor and employs tailored representation similarity functions to approximate various ground truth similarity measures. Extensive experiments demonstrate our model significantly mitigates the curse of dimensionality issue and outperforms the state-of-the-arts in effectiveness, efficiency, and scalability.

轨迹相似性Transformer高效计算可扩展

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。