将凸聚类扩展到核空间,提升非线性数据聚类效果
A New Framework for Convex Clustering in Kernel Spaces: Finite Sample Bounds, Consistency and Performance Insights
- 通过核映射将数据投射至再生核希尔伯特空间进行聚类
- 证明了算法收敛性并给出有限样本误差界
- 适用于非凸、非线性结构数据,适合复杂场景聚类
凸聚类是一种备受关注的聚类方法,类似于Lloyd's k-均值的中心点方法,但无需预设簇数。它从每个数据点作为中心开始,逐步合并。尽管优势明显,但在处理线性不可分或非凸结构的数据时表现不佳。为克服这一局限,我们提出一种核化凸聚类的扩展方法。该方法利用特征映射将数据点投影到再生核希尔伯特空间(RKHS),在变换后的空间中执行凸聚类,不仅更有效地处理复杂数据分布,还生成有限维向量嵌入。本文提供了完整的理论支撑,证明了算法收敛性,并建立了估计值的有限样本边界。通过在合成与真实数据集上的大量实验,验证了该方法在性能上优于当前最先进的聚类技术。本工作在非线性与非凸数据聚类领域取得重要进展。
原文摘要 · Abstract (English)
Convex clustering is a well-regarded clustering method, resembling the similar centroid-based approach of Lloyd's $k$-means, without requiring a predefined cluster count. It starts with each data point as its centroid and iteratively merges them. Despite its advantages, this method can fail when dealing with data exhibiting linearly non-separable or non-convex structures. To mitigate the limitations, we propose a kernelized extension of the convex clustering method. This approach projects the data points into a Reproducing Kernel Hilbert Space (RKHS) using a feature map, enabling convex clustering in this transformed space. This kernelization not only allows for better handling of complex data distributions but also produces an embedding in a finite-dimensional vector space. We provide a comprehensive theoretical underpinning for our kernelized approach, proving algorithmic convergence and establishing finite sample bounds for our estimates. The effectiveness of our method is demonstrated through extensive experiments on both synthetic and real-world datasets, showing superior performance compared to state-of-the-art clustering techniques. This work marks a significant advancement in the field, offering an effective solution for clustering in non-linear and non-convex data scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。