无需预设聚类数,自动发现数据真实聚类数。
Dying Clusters Is All You Need -- Deep Clustering With an Unknown Number of Clusters
- 基于上限估计真实聚类数,可与多种聚类算法结合。
- 在图像和表格数据上显著优于现有自适应聚类方法。
- 适合无标签、聚类数未知的场景,通用性强。
在无标签高维数据(如图像、文本)中发现有意义的聚类是数据挖掘的重要挑战。近年来,深度聚类方法取得了显著进展,但多数方法需预先指定聚类数量,而该数量通常未知。现有方法多将聚类数估计与聚类过程分离,依赖初始嵌入质量,或仅适用于特定聚类流程。本文提出UNSEEN框架,从给定上限出发,自动估计真实聚类数。据我们所知,这是首个能轻松集成于多种深度聚类算法的通用方法。通过与DCN、DEC、DKM结合,在多个图像与表格数据集上进行广泛实验验证其有效性,并通过大量消融分析证明各组件的重要性。代码已开源。
原文摘要 · Abstract (English)
Finding meaningful groups, i.e., clusters, in high-dimensional data such as images or texts without labeled data at hand is an important challenge in data mining. In recent years, deep clustering methods have achieved remarkable results in these tasks. However, most of these methods require the user to specify the number of clusters in advance. This is a major limitation since the number of clusters is typically unknown if labeled data is unavailable. Thus, an area of research has emerged that addresses this problem. Most of these approaches estimate the number of clusters separated from the clustering process. This results in a strong dependency of the clustering result on the quality of the initial embedding. Other approaches are tailored to specific clustering processes, making them hard to adapt to other scenarios. In this paper, we propose UNSEEN, a general framework that, starting from a given upper bound, is able to estimate the number of clusters. To the best of our knowledge, it is the first method that can be easily combined with various deep clustering algorithms. We demonstrate the applicability of our approach by combining UNSEEN with the popular deep clustering algorithms DCN, DEC, and DKM and verify its effectiveness through an extensive experimental evaluation on several image and tabular datasets. Moreover, we perform numerous ablations to analyze our approach and show the importance of its components. The code is available at: https://github.com/collinleiber/UNSEEN
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。