arXiv:2605.09742cs.LGcs.AI2026-05

TIDES让状态空间模型同时支持不规则时间点与强表达能力。

TIDES: Implicit Time-Awareness in Selective State Space Models

  • 将输入依赖从步长移至状态矩阵对角线,保留时间物理意义
  • 在新基准上实现比现有模型更优的外推性能与分类排名
  • 适合需要处理不规则时间序列且追求高表达力的场景

选择性状态空间模型(SSM)如 Mamba 通过将时间离散化步长 $ ilde{ riangle}$ 设为输入相关函数,实现了强每标记表达能力。然而,这导致 $ ilde{ riangle}$ 失去物理采样间隔意义,限制了对不规则时间序列的建模能力。连续时间 SSM(如 S5)保持 $ ilde{ riangle}$ 的物理含义,原生支持不规则时间戳($ ilde{ riangle} riangleq riangle$),但其动态仍为线性时不变(LTI),削弱了每标记表达能力。我们提出 TIDES,一种选择性 SSM 变体,通过将输入依赖从步长转移到对角状态矩阵,使 $ ilde{ riangle}$ 保持物理意义,绑定于状态离散化,从而原生支持不规则时间戳,同时不牺牲选择性模型的表达能力。我们在新提出的 'Fading Flash' 实验基准上验证该方法,该基准是用于诊断序列模型在输入依赖与外推至分布外 $ riangle$ 值方面表现的紧凑控制测试,能区分当前最先进架构的失效模式,而 TIDES 通过设计避免了这些问题。在大规模基准上,TIDES 在 UEA 时间序列分类中取得新的平均排名,并在 Physiome-ODE 回归基准上达到领先水平。代码已开源:https://github.com/TaylanSoydan/TIDES。

原文摘要 · Abstract (English)

Selective state space models (SSMs), such as Mamba, achieve strong per-token expressivity by making the time discretization step $\TildeΔ$ a learned function of the input. However, in doing so, $\TildeΔ$ ceases to represent a physical sampling interval, limiting its irregular time series modeling capability. Continuous-time SSMs, such as S5, preserve the physical meaning of $\TildeΔ$ and handle irregular timestamps natively ($\TildeΔ\equivΔ)$, but their dynamics remain linear time-invariant (LTI), limiting per-token expressivity. We propose \textbf{TIDES}, a selective SSM variant that reconciles selective and continuous architectures by moving input-dependence off the step size and onto the diagonal state matrix. As a result, $\TildeΔ$ retains its physical meaning, tied to the state discretization, allowing the model to handle irregular timestamps natively without sacrificing the per-token expressivity that makes selective SSMs effective. We show this on a novel \emph{Fading Flash} experimental benchmark, a compact controlled diagnostic for sequence models that jointly tests input-dependence and extrapolation to out-of-distribution $Δ$ values, and isolates the distinct failure modes of current state-of-the-art architectures that TIDES avoids by construction. On large-scale benchmarks, TIDES sets the new state-of-the-art average rank on UEA time-series classification and the Physiome-ODE regression benchmark. Code available at: https://github.com/TaylanSoydan/TIDES.

状态空间模型时间序列不规则采样模型表达力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。