分离通道演化模式,提升多变量时间序列预测精度
DisenTS: Disentangled Channel Evolving Pattern Modeling for Multivariate Time Series Forecasting
- 为每个通道独立建模演化模式,避免统一模型的性能损耗
- 通过自适应路由机制,让不同模型专注不同变化规律
- 适合有复杂季节性和趋势变化的多通道数据预测
多变量时间序列预测在众多实际应用中至关重要。主流方法通常采用单一统一模型,通过简单的通道混合嵌入或跨通道注意力来捕捉通道间依赖关系,但常因通道独立性假设牺牲模型容量。由于各通道可能呈现不同演化模式(如多重强季节性、趋势突变),统一建模难以奏效。为此,我们提出 DisenTS,一种针对多变量时间序列中解耦通道演化模式的通用框架。其核心思想是将潜在的多样演化模式以解耦方式建模:使用多个不同的预测模型,各自捕捉一种特定演化模式。为在无监督情况下实现有效路由,提出前馈感知门(FAG)模块,根据预测器状态和输入特征动态生成路由信号。预测器状态通过线性权重近似(LWA)策略提取,将复杂神经网络压缩为紧凑矩阵。同时引入相似性约束(SC),通过最小化表示间的互信息,促使各模型专精于特定底层模式。
原文摘要 · Abstract (English)
Multivariate time series forecasting plays a crucial role in various real-world applications. Significant efforts have been made to integrate advanced network architectures and training strategies that enhance the capture of temporal dependencies, thereby improving forecasting accuracy. On the other hand, mainstream approaches typically utilize a single unified model with simplistic channel-mixing embedding or cross-channel attention operations to account for the critical intricate inter-channel dependencies. Moreover, some methods even trade capacity for robust prediction based on the channel-independent assumption. Nonetheless, as time series data may display distinct evolving patterns due to the unique characteristics of each channel (including multiple strong seasonalities and trend changes), the unified modeling methods could yield suboptimal results. To this end, we propose DisenTS, a tailored framework for modeling disentangled channel evolving patterns in general multivariate time series forecasting. The central idea of DisenTS is to model the potential diverse patterns within the multivariate time series data in a decoupled manner. Technically, the framework employs multiple distinct forecasting models, each tasked with uncovering a unique evolving pattern. To guide the learning process without supervision of pattern partition, we introduce a novel Forecaster Aware Gate (FAG) module that generates the routing signals adaptively according to both the forecasters' states and input series' characteristics. The forecasters' states are derived from the Linear Weight Approximation (LWA) strategy, which quantizes the complex deep neural networks into compact matrices. Additionally, the Similarity Constraint (SC) is further proposed to guide each model to specialize in an underlying pattern by minimizing the mutual information between the representations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。