解决多变量时间序列分类中的相关性漂移问题,提升跨域模型性能。
CATS: Mitigating Correlation Shift for Multivariate Time Series Classification
- 提出相关性适配器CATS,通过时序卷积与图注意力捕捉变量间动态关联。
- 在四个真实数据集上平均准确率提升超10%,参数仅增加约1%。
- 适用于各类Transformer模型,特别适合跨域时间序列任务的工程部署。
无监督域适应(UDA)利用有标签源数据训练模型以应对无标签目标数据。由于多变量时间序列(MTS)在多个领域广泛应用,其分类任务中的UDA已成为关键挑战。然而,现有方法普遍忽略了不同域间变量相关性差异这一核心特性。为此,本文提出新的域偏移类型——相关性漂移,用于量化多变量相关性的域间差异。为缓解该问题,我们设计了可扩展且参数高效的相关性适配器CATS,兼容多种Transformer变体。CATS采用时序卷积捕捉局部时间模式,并结合图注意力模块建模变量间动态相关性,通过重加权使目标域相关性对齐源域,具备理论保障的精度。进一步提出相关性对齐损失,规避了非独立同分布(non-i.i.d.)MTS数据带来的对齐难题。在四个真实数据集上的大量实验表明:(1) 相较于原始Transformer模型,CATS平均准确率提升超过10%,参数仅增加约1%;(2) 所有搭载CATS的Transformer变体均达到或超越现有最优基线。
原文摘要 · Abstract (English)
Unsupervised Domain Adaptation (UDA) leverages labeled source data to train models for unlabeled target data. Given the prevalence of multivariate time series (MTS) data across various domains, the UDA task for MTS classification has emerged as a critical challenge. However, for MTS data, correlations between variables often vary across domains, whereas most existing UDA works for MTS classification have overlooked this essential characteristic. To bridge this gap, we introduce a novel domain shift, {\em correlation shift}, measuring domain differences in multivariate correlation. To mitigate correlation shift, we propose a scalable and parameter-efficient \underline{C}orrelation \underline{A}dapter for M\underline{TS} (CATS). Designed as a plug-and-play technique compatible with various Transformer variants, CATS employs temporal convolution to capture local temporal patterns and a graph attention module to model the changing multivariate correlation. The adapter reweights the target correlations to align the source correlations with a theoretically guaranteed precision. A correlation alignment loss is further proposed to mitigate correlation shift, bypassing the alignment challenge from the non-i.i.d. nature of MTS data. Extensive experiments on four real-world datasets demonstrate that (1) compared with vanilla Transformer-based models, CATS increases over $10\%$ average accuracy while only adding around $1\%$ parameters, and (2) all Transformer variants equipped with CATS either reach or surpass state-of-the-art baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。