用随机傅里叶特征加速核k均值,提升大规模数据聚类效率与抗噪能力
Enhancing Kernel Power K-means: Scalable and Robust Clustering with Random Fourier Features and Possibilistic Method
- 引入随机傅里叶特征替代完整核矩阵,实现高效低维映射
- 理论证明误差上界为O(√(k³/n)),且在小样本下仍具强一致性
- 结合可能性隶属度,适合处理噪声数据和多核场景
核幂k均值(KPKM)通过一族中心点缓解核k均值的局部极小问题。然而,其面临两大挑战:(1)完整核矩阵带来的计算开销限制了在大规模数据上的应用;(2)缺乏真实的中心-样本归属学习,降低对噪声的鲁棒性。为此,我们提出RFF-KPKM,首次建立随机傅里叶特征(RFF)应用于KPKM的近似理论。RFF-KPKM利用RFF生成高效低维特征映射,避免构建完整核矩阵。关键贡献在于:(1)过剩风险上界为O(√(k³/n));(2)成员值具有强一致性;(3)仅需poly(ε⁻¹ log k)维度的RFF即可实现(1+ε)相对误差。为进一步提升鲁棒性和多核学习能力,提出IP-RFF-MKPKM——基于可能性的RFF多核幂k均值。该方法通过RFF保证MKPKM可扩展性,并融合可能性与模糊隶属度优势优化聚类分配。大规模数据集实验表明,所提方法在效率与聚类精度上均优于当前最优方法。
原文摘要 · Abstract (English)
Kernel power $k$-means (KPKM) leverages a family of means to mitigate local minima issues in kernel $k$-means. However, KPKM faces two key limitations: (1) the computational burden of the full kernel matrix restricts its use on extensive data, and (2) the lack of authentic centroid-sample assignment learning reduces its noise robustness. To overcome these challenges, we propose RFF-KPKM, introducing the first approximation theory for applying random Fourier features (RFF) to KPKM. RFF-KPKM employs RFF to generate efficient, low-dimensional feature maps, bypassing the need for the whole kernel matrix. Crucially, we are the first to establish strong theoretical guarantees for this combination: (1) an excess risk bound of $\mathcal{O}(\sqrt{k^3/n})$, (2) strong consistency with membership values, and (3) a $(1+\varepsilon)$ relative error bound achievable using the RFF of dimension $\mathrm{poly}(\varepsilon^{-1}\log k)$. Furthermore, to improve robustness and the ability to learn multiple kernels, we propose IP-RFF-MKPKM, an improved possibilistic RFF-based multiple kernel power $k$-means. IP-RFF-MKPKM ensures the scalability of MKPKM via RFF and refines cluster assignments by combining the merits of the possibilistic membership and fuzzy membership. Experiments on large-scale datasets demonstrate the superior efficiency and clustering accuracy of the proposed methods compared to the state-of-the-art alternatives.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。