arXiv:2507.08243cs.LG2025-07

通过密度与几何关联提升聚类性能,显著改善经典算法效果。

CoreSPECT: Enhancing Clustering Algorithms via an Interplay of Density and Geometry

  • 利用数据密度与几何结构的关联,选取关键区域进行聚类
  • 使K-Means平均NMI提升20%,HDBSCAN提升超100%
  • 无需调参且速度快,适合图像与基因组等真实数据

本文从真实数据中普遍存在但常被忽视的密度-几何相关性出发,揭示其表现为多层流形结构。基于此,提出CoreSPECT框架——一种通用聚类增强方法,通过在选定核心区域应用聚类算法,并结合新型邻域图多层传播机制,将局部划分扩展为完整划分。在19个真实世界数据集(含标准图像与基因组数据)上验证,该框架使K-Means平均NMI提升20%,可媲美甚至超越当前最优流形聚类方法,且速度优势达数量级;同时使HDBSCAN平均NMI提升超过100%,在多数情况下达到顶尖水平,且无需预知簇数或调参。整体ARI提升更显著。

原文摘要 · Abstract (English)

In this paper, we provide a novel perspective on the underlying structure of real-world data with ground-truth clusters via characterization of an abundantly observed yet often overlooked density-geometry correlation, that manifests itself as a multi-layered manifold structure. We leverage this correlation to design CoreSPECT (Core Space Projection based Enhancement of Clustering Techniques), a general framework that improves the performance of generic clustering algorithms. Our framework boosts the performance of clustering algorithms by applying them to strategically selected regions, then extending the partial partition to a complete partition for the dataset using a novel neighborhood graph based multi-layer propagation procedure. We provide initial theoretical support of the functionality of our framework under the assumption of our model, and then provide large-scale real-world experiments on 19 datasets that include standard image datasets as well as genomics datasets. We observe two notable improvements. First, CoreSPECT improves the NMI of K-Means by 20% on average, making it competitive to (and in some cases surpassing) the state-of-the-art manifold-based clustering algorithms, while being orders of magnitude faster. Secondly, our framework boosts the NMI of HDBSCAN by more than 100% on average, making it competitive to the state-of-the-art in several cases without requiring the true number of clusters and hyper-parameter tuning. The overall ARI improvements are higher.

聚类增强密度几何多层流形无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。