用概率连续化方法让时间序列模型更平滑可解释。
Interpretable time series analysis with Gumbel dynamics
- 用Gumbel分布实现离散状态的连续松弛,提升建模灵活性。
- 可微分训练,支持高效梯度优化,适配真实数据复杂动态。
- 适合需要解释性的时序分析场景,如多态随机过程建模。
切换动力系统可通过推断有限个动力学基元来建模复杂时间序列数据,并保持可解释性。然而由于状态集合的离散性,这类模型难以捕捉平滑、变速的过渡过程,也难以处理重叠状态的随机混合,导致在真实数据上常出现虚假的快速切换。本文提出Gumbel动力学模型(GDM):首先,通过引入离散状态的连续松弛及基于该松弛空间的Gumbel噪声模型,扩展了可用状态动力学的范围,使模型能更准确地逼近平滑、非平稳的真实动态;其次,该松弛使模型完全可微,支持使用标准梯度下降法进行快速可扩展训练。我们在标准仿真数据集上验证了该方法,展示了其在随机设置下对软状态与粘滞过渡的建模能力。进一步应用于两个真实数据集,证明其能在具有多重动态的随机时间序列中推断出可解释的状态,而传统方法在此类场景中常失效。
原文摘要 · Abstract (English)
Switching dynamical systems can model complicated time series data while maintaining interpretability by inferring a finite set of dynamics primitives and explaining different portions of the observed time series with one of these primitives. However, due to the discrete nature of this set, such models struggle to capture smooth, variable-speed transitions, as well as stochastic mixtures of overlapping states, and the inferred dynamics often display spurious rapid switching on real-world datasets. Here, we propose the Gumbel Dynamical Model (GDM). First, by introducing a continuous relaxation of discrete states and a different noise model defined on the relaxed-discrete state space via the Gumbel distribution, GDM expands the set of available state dynamics, allowing the model to approximate smoother and non-stationary ground-truth dynamics more faithfully. Second, the relaxation makes the model fully differentiable, enabling fast and scalable training with standard gradient descent methods. We validate our approach on standard simulation datasets and highlight its ability to model soft, sticky states and transitions in a stochastic setting. Furthermore, we apply our model to two real-world datasets, demonstrating its ability to infer interpretable states in stochastic time series with multiple dynamics, a setting where traditional methods often fail.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。