arXiv:2603.26097cs.LGcs.AI2026-03被引 2

用强化学习动态切分序列,让模型自适应地压缩长时序数据。

Dynamic Tokenization via Reinforcement Patching: End-to-end Training and Zero-shot Transfer

  • 通过强化学习优化切片边界,避免传统软离散化方法
  • 在时间序列预测上超越现有自适应切块方法,支持指定压缩率
  • 模块可独立使用,适合研究序列分割机制的学者

高效聚合空间或时间跨度以获得紧凑表示已成为现代深度学习模型的通用原则,但针对长时序序列数据(尤其是连续时间序列)学习数据自适应表示仍是开放挑战。尽管固定大小切块提升了可扩展性和性能,但实现端到端的变长、数据驱动切块通常依赖软离散化、特定主干网络或启发式规则。本文提出强化切块(ReinPatch),首个联合优化序列切块策略与下游序列主干模型的框架,将切块边界放置建模为离散决策过程,通过组相对策略梯度(GRPG)进行优化,无需连续松弛,实现自然的动态切块策略优化。此外,本方法可严格约束目标压缩率,使下游主干高效扩展,并天然支持多层级层次化建模。我们在时间序列预测数据集上评估 ReinPatch,结果表明其性能显著优于现有自适应切块策略。更进一步,解耦设计使切块模块可作为独立基础切块器提取,为社区提供纯性能驱动神经切块策略的视觉与实证洞察。

原文摘要 · Abstract (English)

Efficiently aggregating spatial or temporal horizons to acquire compact representations has become a unifying principle in modern deep learning models, yet learning data-adaptive representations for long-horizon sequence data, especially continuous sequences like time series, remains an open challenge. While fixed-size patching has improved scalability and performance, discovering variable-sized, data-driven patches end-to-end often forces models to rely on soft discretization, specific backbones, or heuristic rules. In this work, we propose Reinforcement Patching (ReinPatch), the first framework to jointly optimize a sequence patching policy and its downstream sequence backbone model using reinforcement learning. By formulating patch boundary placement as a discrete decision process optimized via Group Relative Policy Gradient (GRPG), ReinPatch bypasses the need for continuous relaxations and performs dynamic patching policy optimization in a natural manner. Moreover, our method allows strict enforcement of a desired compression rate, freeing the downstream backbone to scale efficiently, and naturally supports multi-level hierarchical modeling. We evaluate ReinPatch on time-series forecasting datasets, where it demonstrates compelling performance compared to state-of-the-art data-driven patching strategies. Furthermore, our detached design allows the patching module to be extracted as a standalone foundation patcher, providing the community with visual and empirical insights into the segmentation behaviors preferred by a purely performance-driven neural patching strategy.

序列建模强化学习动态切块时间序列

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。