arXiv:2412.03715cs.LGcs.AI2024-12被引 1

用强化学习优化轨迹路径片段提取,大幅压缩存储空间。

PathletRL++: Optimizing Trajectory Pathlet Extraction and Dictionary Formation via Reinforcement Learning

  • 自底向上逐步合并基础路径片段,降低冗余。
  • 相比基线方法内存减少24000倍,字典规模缩小65.8%。
  • 适合处理大规模轨迹数据的高效压缩与重建场景。

追踪技术的发展推动了大规模轨迹数据的快速增长。构建紧凑的路径片段集合(即轨迹路径片段字典)对支持移动性相关应用至关重要。现有方法通常采用自顶向下策略,生成大量候选片段并筛选子集,导致内存占用高且存在重叠冗余。为此,我们提出一种自底向上的策略,从单位长度片段开始,逐步合并并优化其效用,效用由新提出的轨迹损失和可表示性度量定义。我们构建了基于深度Q网络(DQN)的强化学习框架PathletRL,实现高效路径片段字典生成。在合成与真实数据集上的实验表明,该方法优于当前最优技术,字典规模最多减少65.8%。此外,仅需一半字典片段即可重构85%原始轨迹数据。在此基础上,我们提出PathletRL++,通过更丰富的状态表示和改进的奖励函数优化合并决策,使智能体获得更细致的环境理解,进一步提升字典质量。PathletRL++在保持高可表示性的同时,优于原模型,实现更大规模压缩。

原文摘要 · Abstract (English)

Advances in tracking technologies have spurred the rapid growth of large-scale trajectory data. Building a compact collection of pathlets, referred to as a trajectory pathlet dictionary, is essential for supporting mobility-related applications. Existing methods typically adopt a top-down approach, generating numerous candidate pathlets and selecting a subset, leading to high memory usage and redundant storage from overlapping pathlets. To overcome these limitations, we propose a bottom-up strategy that incrementally merges basic pathlets to build the dictionary, reducing memory requirements by up to 24,000 times compared to baseline methods. The approach begins with unit-length pathlets and iteratively merges them while optimizing utility, which is defined using newly introduced metrics of trajectory loss and representability. We develop a deep reinforcement learning framework, PathletRL, which utilizes Deep Q-Networks (DQN) to approximate the utility function, resulting in a compact and efficient pathlet dictionary. Experiments on both synthetic and real-world datasets demonstrate that our method outperforms state-of-the-art techniques, reducing the size of the constructed dictionary by up to 65.8%. Additionally, our results show that only half of the dictionary pathlets are needed to reconstruct 85% of the original trajectory data. Building on PathletRL, we introduce PathletRL++, which extends the original model by incorporating a richer state representation and an improved reward function to optimize decision-making during pathlet merging. These enhancements enable the agent to gain a more nuanced understanding of the environment, leading to higher-quality pathlet dictionaries. PathletRL++ achieves even greater dictionary size reduction, surpassing the performance of PathletRL, while maintaining high trajectory representability.

轨迹压缩强化学习路径片段数据存储

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。