arXiv:2507.19119cs.CVcs.AI2025-07

用动态分块统一建模轨迹的时间与频率特征,提升预测精度。

PatchTraj: Unified Time-Frequency Representation Learning via Dynamic Patches for Trajectory Prediction

  • 将轨迹分解为时序与频域成分,通过动态分块捕捉多尺度运动模式。
  • 在JRDB数据集上相对改进26.7%(ADE)和17.4%(FDE),性能领先。
  • 适合需要高精度行人轨迹预测的自动驾驶与机器人场景。

行人轨迹预测对自动驾驶与机器人至关重要。现有基于点或网格的方法存在两大局限:难以同时平衡局部运动细节与长程时空依赖,且时间表示与频域成分缺乏协同建模。为此,我们提出PatchTraj,一种基于动态分块的时频联合建模范式。具体地,将轨迹分解为原始时序序列与频域成分,采用动态分块进行多尺度分割,捕获层级化运动模式;每个分块经尺度感知的自适应嵌入与特征提取后,通过层次化特征聚合建模细粒度与长程依赖;双分支输出通过跨模态注意力增强,实现时序与谱信息的互补融合。最终嵌入具备强表达能力,即使使用基础Transformer也能实现高精度预测。在ETH-UCY、SDD、NBA与JRDB数据集上的大量实验表明,该方法达到当前最优性能。尤其在视角内视角的JRDB数据集上,相对改进达26.7%(ADE)与17.4%(FDE),凸显其在具身智能中的巨大潜力。

原文摘要 · Abstract (English)

Pedestrian trajectory prediction is crucial for autonomous driving and robotics. While existing point-based and grid-based methods expose two main limitations: insufficiently modeling human motion dynamics, as they fail to balance local motion details with long-range spatiotemporal dependencies, and the time representations lack interaction with their frequency components in jointly modeling trajectory sequences. To address these challenges, we propose PatchTraj, a dynamic patch-based framework that integrates time-frequency joint modeling for trajectory prediction. Specifically, we decompose the trajectory into raw time sequences and frequency components, and employ dynamic patch partitioning to perform multi-scale segmentation, capturing hierarchical motion patterns. Each patch undergoes adaptive embedding with scale-aware feature extraction, followed by hierarchical feature aggregation to model both fine-grained and long-range dependencies. The outputs of the two branches are further enhanced via cross-modal attention, facilitating complementary fusion of temporal and spectral cues. The resulting enhanced embeddings exhibit strong expressive power, enabling accurate predictions even when using a vanilla Transformer architecture. Extensive experiments on ETH-UCY, SDD, NBA, and JRDB datasets demonstrate that our method achieves state-of-the-art performance. Notably, on the egocentric JRDB dataset, PatchTraj attains significant relative improvements of 26.7% in ADE and 17.4% in FDE, underscoring its substantial potential in embodied intelligence.

轨迹预测时频建模动态分块具身智能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。