用稀疏表示分层聚类,高效处理高维数据流中的噪声与变化。
Hierarchical Sparse Representation Clustering for High-Dimensional Data Streams
- 通过l1最小化构建自适应邻域的亲和矩阵,捕捉高维数据关联性。
- 基于稀疏相似度合并微簇,实现动态聚类并检测异常点。
- 适合处理含噪声的高维实时数据流,如传感器或用户行为序列。
数据流聚类旨在揭示连续到达、可能无限的数据序列中的模式。现有数据流聚类算法在处理高维数据流时仍面临挑战:一是使用欧氏距离难以衡量高维数据对象间的相似性;二是对高维数据流中的噪声敏感。本文提出一种分层稀疏表示聚类(HSRC)方法,首先在固定大小的地标窗口中利用l1-最小化技术学习数据对象的亲和矩阵,自动选择邻近数据对象数量,确保同一簇内高度相关样本被聚在一起。随后,对亲和矩阵进行谱聚类生成微簇,并依据稀疏相似度(SSD)将微簇合并为宏簇。此外,引入稀疏残差值(SRV)自适应选取当前窗口的代表性数据对象作为下一窗口的字典样本。最后,通过精细化调整优化每个宏簇。实验结果表明,该方法在多个基准数据集上表现出优异的有效性与鲁棒性。
原文摘要 · Abstract (English)
Data stream clustering reveals patterns within continuously arriving, potentially unbounded data sequences. Numerous data stream algorithms have been proposed to cluster data streams. The existing data stream clustering algorithms still face significant challenges when addressing high-dimensional data streams. First, it is intractable to measure the similarities among high-dimensional data objects via Euclidean distances when constructing and merging microclusters. Second, these algorithms are highly sensitive to the noise contained in high-dimensional data streams. In this paper, we propose a hierarchical sparse representation clustering (HSRC) method for clustering high-dimensional data streams. HSRC first employs an $l_1$-minimization technique to learn an affinity matrix for data objects in individual landmark windows with fixed sizes, where the number of neighboring data objects is automatically selected. This approach ensures that highly correlated data samples within clusters are grouped together. Then, HSRC applies a spectral clustering technique to the affinity matrix to generate microclusters. These microclusters are subsequently merged into macroclusters based on their sparse similarity degrees (SSDs). Additionally, HSRC introduces sparsity residual values (SRVs) to adaptively select representative data objects from the current landmark window. These representatives serve as dictionary samples for the next landmark window. Finally, HSRC refines each macrocluster through fine-tuning. In particular, HSRC enables the detection of outliers in high-dimensional data streams via the associated SRVs. The experimental results obtained on several benchmark datasets demonstrate the effectiveness and robustness of HSRC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。