arXiv:2606.04074cs.LGcs.AI2026-06

自适应分块未必更好,需与调优后的均匀分块对比才知价值。

Adaptive Patching Is Harder Than It Looks For Time-Series Forecasting

论文配图:Adaptive Patching Is Harder Than It Looks For Time-Series Forecasting
图 1 · 摘自论文原文
  • 将分块视为带预算的比特率分配,推导出动态分块优于均匀分块的明确阈值。
  • 实验证明在长时序预测任务中,调优后的均匀分块与自适应分块性能相当,无系统性优势。
  • 自适应分块的价值取决于能否找到可靠信号,识别出真正需要细粒度建模的区域。

自适应分块是时间序列Transformer的近期新方法:在局部信息丰富的区域分配更细的分块。本文探究在何种条件下内容自适应分块能超越调优后的均匀分块。仅局部异质性不足:在点对点预测损失下,复杂区域并不自动因更细分块而降低损失。我们将分块建模为预算约束的比特率分配,推导出动态分块规则必须满足的显式阈值,进而分别在局部(二次近似)和全局(强凸性假设下)界定可实现的改进上限。两个结构性结论随之得出:若无耦合约束,标量局部复杂度无法在常见损失曲面上产生非均匀最优解;一旦骨干网络训练至表示感知最优,对齐增益会围绕一个调优后的均匀分块大小坍缩。为验证预测,我们在三种代表性架构上进行受控隔离实验,将每个自适应机制替换为均匀分块扫描,保持骨干、数据和训练协议不变。在标准长时程预测基准上,验证集选择的均匀基线表现与动态版本相当,各设置下的效果集中在零附近,聚合到数据集层面后无一致方向性优势。观察到的较大增益具有方法和数据集特异性。因此,自适应分块应与调优后的均匀基线对比评估;其价值取决于能否以低成本可靠地识别出真正减少预测误差的精细分块区域。

原文摘要 · Abstract (English)

Adaptive patching is a recent and compelling proposal for time-series Transformers: allocate finer patches where the sequence looks locally informative. This paper asks under what conditions a content-adaptive patching operator should outperform a tuned uniform one. Local heterogeneity alone is not enough: under pointwise forecasting losses, a complex-looking region is not automatically one where finer patching reduces the loss. We model patching as a budgeted bitrate allocation and derive an explicit threshold that a dynamic patching rule must satisfy to beat a well-tuned uniform baseline, then bound the achievable improvement both locally (a quadratic surrogate) and globally (a strong-convexity bound under the model's assumptions). Two structural results follow: without a coupling constraint, scalar local complexity cannot produce a non-uniform optimum under a common loss landscape; and once the backbone is trained to its representation-aware optimum, the alignment gain collapses around a well-tuned uniform patch size. To test these predictions, we run a controlled isolation study on three representative architectures, replacing each adaptive mechanism with a uniform patch-size sweep while keeping the backbone, data, and training protocol fixed. On standard long-horizon forecasting benchmarks, the validation-selected uniform baseline is competitive with the dynamic counterpart, with per-setting effects concentrated near zero and no consistent directional advantage once results are aggregated by dataset. The larger gains we do observe are method- and dataset-specific. Adaptive patching should therefore be evaluated against a tuned uniform baseline; its value depends on whether a cheap and reliable routing signal can identify where finer patches actually reduce forecasting loss.

时间序列Transformer分块策略模型评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。