提出可持续学习的时序聚类方法,避免遗忘旧任务
LDTC: Lifelong deep temporal clustering for multivariate time series
- 端到端深度自编码器联合优化表征与聚类
- 在7个真实数据集上实现高精度聚类结果
- 支持动态模型扩展,适合持续学习场景
从现实世界中复杂多变量时序数据中进行动态聚类是重要挑战。尽管已有深度方法优于传统方法,但准确率仍不理想,且缺乏对连续任务学习中动态数据的有效处理能力。本文提出全新的终身深度时序聚类(LDTC)算法,将降维与时序聚类统一于端到端无监督框架中。通过设计专用自编码器并联合优化潜在表示与聚类目标,实现高质量聚类。更重要的是,LDTC引入动态模型扩展与回放机制,可在不发生灾难性遗忘的前提下持续学习新任务,有效应对序列任务中的动态数据。在7个真实多变量时序数据集上的实验表明,该方法在效率和准确性上均表现优异。
原文摘要 · Abstract (English)
Clustering temporal and dynamically changing multivariate time series from real-world fields, called temporal clustering for short, has been a major challenge due to inherent complexities. Although several deep temporal clustering algorithms have demonstrated a strong advantage over traditional methods in terms of model learning and clustering results, the accuracy of the few algorithms are not satisfactory. None of the existing algorithms can continuously learn new tasks and deal with the dynamic data effectively and efficiently in the sequential tasks learning. To bridge the gap and tackle these issues, this paper proposes a novel algorithm \textbf{L}ifelong \textbf{D}eep \textbf{T}emporal \textbf{C}lustering (\textbf{LDTC}), which effectively integrates dimensionality reduction and temporal clustering into an end-to-end deep unsupervised learning framework. Using a specifically designed autoencoder and jointly optimizing for both the latent representation and clustering objective, the LDTC can achieve high-quality clustering results. Moreover, unlike any previous work, the LDTC is uniquely equipped with the fully dynamic model expansion and rehearsal-based techniques to effectively learn new tasks and to tackle the dynamic data in the sequential tasks learning without the catastrophic forgetting or degradation of the model accuracy. Experiments on seven real-world multivariate time series datasets show that the LDTC is a promising method for dealing with temporal clustering issues effectively and efficiently.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。