用柯西-拉奥乘积构建更简洁的聚类中心,减少冗余。
Khatri-Rao Clustering for Data Summarization
- 通过多组原型中心的交互生成聚类中心,降低冗余。
- 相比标准k-Means,摘要更紧凑且精度相当。
- 适合需要压缩数据表示的场景,如大规模数据处理。
随着数据集规模和复杂度持续增长,如何生成简洁而准确的数据摘要成为关键挑战。基于质心的聚类方法通过少量原型代表数据中的簇,广泛应用于数据摘要。然而,现有方法常产生冗余信息,尤其在存在大量潜在簇时效果受限。为此,本文提出柯西-拉奥聚类范式,将传统质心聚类扩展为由两组或多组简洁原型中心相互作用生成质心,从而实现更紧凑但同样精确的摘要。我们在经典k-Means算法与日益流行的深度聚类框架上应用该范式,分别提出柯西-拉奥k-Means算法与柯西-拉奥深度聚类框架。大量实验表明,柯西-拉奥k-Means在简洁性与准确性之间取得更优平衡;结合表示学习的柯西-拉奥深度聚类框架进一步压缩了深度聚类生成的摘要规模,同时保持其精度。该方法显著提升了数据摘要的紧凑性,适用于高维、大规模数据的高效表征。
原文摘要 · Abstract (English)
As datasets continue to grow in size and complexity, finding succinct yet accurate data summaries poses a key challenge. Centroid-based clustering, a widely adopted approach to address this challenge, finds informative summaries of datasets in terms of few prototypes, each representing a cluster in the data. Despite their wide adoption, the resulting data summaries often contain redundancies, limiting their effectiveness particularly in datasets characterized by a large number of underlying clusters. To overcome this limitation, we introduce the Khatri-Rao clustering paradigm that extends traditional centroid-based clustering to produce more succinct but equally accurate data summaries by postulating that centroids arise from the interaction of two or more succinct sets of protocentroids. We study two central approaches to centroid-based clustering, namely the well-established k-Means algorithm and the increasingly popular topic of deep clustering, under the lens of the Khatri-Rao paradigm. To this end, we introduce the Khatri-Rao k-Means algorithm and the Khatri-Rao deep clustering framework. Extensive experiments show that Khatri-Rao k-Means can strike a more favorable trade-off between succinctness and accuracy in data summarization than standard k-Means. Leveraging representation learning, the Khatri-Rao deep clustering framework offers even greater benefits, reducing even more the size of data summaries given by deep clustering while preserving their accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。