arXiv:2410.02201cs.CV2024-10被引 2

用离散记忆模拟人类回忆,提升轨迹预测效率与泛化能力

Remember and Recall: Associative-Memory-based Trajectory Prediction

  • 构建可学习的离散记忆数组,压缩轨迹特征并减少冗余
  • 在多个数据集上实现优于现有方法的预测精度,尤其在陌生场景表现更优
  • 适合关注高效智能驾驶轨迹预测的研究者和工程团队

轨迹预测是自动驾驶系统的关键组件,使系统能够将过往运动经验应用于当前场景。尽管现有方法多聚焦于学习连续表示以获取经验,但常面临计算效率低及面对新场景表现不佳的问题。为此,我们提出基于碎片化记忆的轨迹预测模型(FMTP),受人类卓越学习能力启发,尤其是其在陌生情境中调用相关记忆的能力。该模型采用离散表示,在训练阶段通过量化操作整合训练集中的连续轨迹表示,形成可学习的记忆数组,从而在保留关键特征的同时消除冗余信息,提升计算效率。此外,设计基于语言模型的高级推理引擎,深入学习离散表示间的关联规则。在ETH-UCY、inD、SDD、nuScenes、Waymo和VTL-TP等多个公开数据集上的实验表明,本方法显著提升预测性能,能从历史轨迹中提取更丰富的经验以指导当前状态判断。

原文摘要 · Abstract (English)

Trajectory prediction is a pivotal component of autonomous driving systems, enabling the application of accumulated movement experience to current scenarios. Although most existing methods concentrate on learning continuous representations to gain valuable experience, they often suffer from computational inefficiencies and struggle with unfamiliar situations. To address this issue, we propose the Fragmented-Memory-based Trajectory Prediction (FMTP) model, inspired by the remarkable learning capabilities of humans, particularly their ability to leverage accumulated experience and recall relevant memories in unfamiliar situations. The FMTP model employs discrete representations to enhance computational efficiency by reducing information redundancy while maintaining the flexibility to utilize past experiences. Specifically, we design a learnable memory array by consolidating continuous trajectory representations from the training set using defined quantization operations during the training phase. This approach further eliminates redundant information while preserving essential features in discrete form. Additionally, we develop an advanced reasoning engine based on language models to deeply learn the associative rules among these discrete representations. Our method has been evaluated on various public datasets, including ETH-UCY, inD, SDD, nuScenes, Waymo, and VTL-TP. The extensive experimental results demonstrate that our approach achieves significant performance and extracts more valuable experience from past trajectories to inform the current state.

轨迹预测记忆机制自动驾驶离散表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。