arXiv:2503.00127cs.LGstat.ML2025-03被引 2

提出首个显式评估噪声划分质量的聚类评价方法,解决密度聚类中噪声判定难题。

Internal Evaluation of Density-Based Clusterings with Noise

  • 基于轮廓系数思想,用密度连通性评估任意形状簇
  • 显式奖励正确识别的噪声点,惩罚应属簇内却标为噪声的点
  • 支持单点簇、单一主簇加噪声等边界情况,可解释性强

在缺乏真实标签的情况下评估聚类质量是数据挖掘研究的核心问题。然而,大多数聚类验证指标(CVI)无法捕捉密度聚类方法(如DBSCAN或HDBSCAN)中的噪声分配,尽管准确识别噪声对成功聚类至关重要。本文提出DISCO——首个显式评估噪声划分质量的密度基内部评分方法。DISCO基于轮廓系数思想,但采用密度连通性评估任意形状簇,并引入显式噪声评估机制:对正确标记的噪声点给予奖励,对本应属于簇却被标记为噪声的点进行惩罚。其逐点定义使噪声评估可无缝融入最终聚类评价,同时支持可解释性分析。与多数现有方法不同,DISCO在数学上定义明确,且能处理算法输出中常见的边界情况,如单点簇或单一簇加噪声的情形。

原文摘要 · Abstract (English)

Being able to evaluate the quality of a clustering result even in the absence of ground truth cluster labels is fundamental for research in data mining. However, most cluster validation indices (CVIs) do not capture noise assignments by density-based clustering methods like DBSCAN or HDBSCAN, even though the ability to correctly determine noise is crucial for successful clustering. In this paper, we propose DISCO, a Density-based Internal Score for Clusterings with nOise, the first CVI to explicitly assess the quality of noise assignments rather than merely counting them. DISCO is based on the established idea of the Silhouette Coefficient, but adopts density-connectivity to evaluate clusters of arbitrary shapes, and proposes explicit noise evaluation: it rewards correctly assigned noise labels and penalizes noise labels where a cluster label would have been more appropriate. The pointwise definition of DISCO allows for the seamless integration of noise evaluation into the final clustering evaluation, while also enabling explainable evaluations of the clustered data. In contrast to most state-of-the-art, DISCO is well-defined and also covers edge cases that regularly appear as output from clustering algorithms, such as singleton clusters or a single cluster plus noise.

聚类评估密度聚类噪声检测内部指标

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。