提出可自适应确定聚类数的正则化k-means方法
Number of Clusters in a Dataset: A Regularized K-means Approach
- 基于理想球形簇假设推导正则化系数λ的理论边界
- 对比加法与乘法正则化,提升聚类结果稳定性
- 适用于对聚类数不敏感、追求稳健分组的场景
在无标签数据中确定有意义的聚类数量在诸多应用中至关重要。正则化k-means是一种常用方法,其最常见形式为添加线性正则项λk,其中k为聚类数,λ为正系数。然而目前缺乏设定关键超参数λ的系统性指导。本文在假设聚类为理想球形(即维度为d、半径相同的球体)的前提下,推导出λ的严格边界。这类理想簇是k-means簇(各向同性高斯分布、标准差相同)的良好近似。实验表明,带加法正则项的k-means常产生多个解。因此,本文还分析了乘法正则化形式。通过融合加法与乘法正则化所得解的共识,可在某些情况下降低多解带来的模糊性。此外,文中还展示了当真实簇偏离理想假设时,正则化k-means的表现情况。
原文摘要 · Abstract (English)
Finding the number of meaningful clusters in an unlabeled dataset is important in many applications. Regularized k-means algorithm is a possible approach frequently used to find the correct number of distinct clusters in datasets. The most common formulation of the regularization function is the additive linear term $λk$, where $k$ is the number of clusters and $λ$ a positive coefficient. Currently, there are no principled guidelines for setting a value for the critical hyperparameter $λ$. In this paper, we derive rigorous bounds for $λ$ assuming clusters are {\em ideal}. Ideal clusters (defined as $d$-dimensional spheres with identical radii) are close proxies for k-means clusters ($d$-dimensional spherically symmetric distributions with identical standard deviations). Experiments show that the k-means algorithm with additive regularizer often yields multiple solutions. Thus, we also analyze k-means algorithm with multiplicative regularizer. The consensus among k-means solutions with additive and multiplicative regularizations reduces the ambiguity of multiple solutions in certain cases. We also present selected experiments that demonstrate performance of the regularized k-means algorithms as clusters deviate from the ideal assumption.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。