通过对比学习分离时序张量的模式特异性与共性特征
Disentangled Mode-Specific Representations for Tensor Time Series via Contrastive Learning
- 用张量切片降维,分拆模式特异与不变特征
- 对比损失使分类和预测准确率超越现有方法
- 适合处理多模态时序数据的表征学习任务
多模态张量时间序列(TTS)广泛存在于搜索引擎和环境监测系统中。学习其表示有助于各类应用,但张量结构的复杂性带来了挑战。本文提出一种专为TTS设计的表示学习方法MoST:通过张量切片降低结构复杂度,将表示解耦为模式特异性特征(同一模式内变量关系)和模式不变性特征(跨模式共性)。采用对比学习框架,损失函数包含两部分,分别用于学习模式特异和模式不变表示,有效利用解耦表示作为增强。在真实数据集上的大量实验表明,MoST在分类与预测准确率上持续优于现有最先进方法。代码已开源:https://github.com/KoheiObata/MoST。
原文摘要 · Abstract (English)
Multi-mode tensor time series (TTS) can be found in many domains, such as search engines and environmental monitoring systems. Learning representations of a TTS benefits various applications, but it is also challenging since the complexities inherent in the tensor hinder the realization of rich representations. In this paper, we propose a novel representation learning method designed specifically for TTS, namely MoST. Specifically, MoST uses a tensor slicing approach to reduce the complexity of the TTS structure and learns representations that can be disentangled into individual non-temporal modes. Each representation captures mode-specific features, which are the relationship between variables within the same mode, and mode-invariant features, which are in common in representations of different modes. We employ a contrastive learning framework to learn parameters; the loss function comprises two parts intended to learn representation in a mode-specific way and mode-invariant way, effectively exploiting disentangled representations as augmentations. Extensive experiments on real-world datasets show that MoST consistently outperforms the state-of-the-art methods in terms of classification and forecasting accuracy. Code is available at https://github.com/KoheiObata/MoST.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。