arXiv:2608.28799math.NAcs.LG2026-08

提出新方法提升非负矩阵分解的稀疏性和可识别性,性能更优且计算高效。

Separable Nonnegative Matrix Factorization Using Powered Ratio-of-Norms Regularization

  • 基于幂比范数正则化构建新模型,增强因子稀疏性与可区分性
  • 在合成数据和手势分类任务中,锚点识别准确率更高,分类效果更优
  • 结合DCA与ADMM算法,求解稳定,适合大规模非负数据处理

分离式非负矩阵分解(SNMF)因其能生成基于局部部件且可解释的低秩表示,被广泛用于非负数据的低秩表示与聚类,尤其与图聚类和社区检测密切相关。为提升所学因子的稀疏性与可识别性,本文提出一种基于幂比范数正则化的ℓ₁ᵖ/ℓ₂-正则化SNMF模型。该模型为非凸、非光滑,优化难度大。为此,我们基于差分凸函数算法(DCA)和交替方向乘子法(ADMM)设计了高效算法,将原问题分解为可处理的子问题,并利用幂范数项对应的闭式近端算子。理论分析表明,DCA具有下降性与极限临界性,而标准假设下ADMM具有收敛性。大量数值实验在合成数据集与手部姿态分类任务上表明,相比现有方法,该方法在锚点识别与分类准确率方面表现相当或更优,同时保持良好计算效率。

原文摘要 · Abstract (English)

Separable nonnegative matrix factorization (SNMF) has been widely used for low-rank representation and clustering of nonnegative data, owing to its ability to produce part-based and interpretable decompositions. In particular, SNMF is closely related to graph clustering and community detection. To enhance sparsity and identifiability of the learned factors, we propose an $\ell_1^p/\ell_2$-regularized SNMF model based on a powered ratio-of-norms regularizer. The resulting formulation is nonconvex and nonsmooth, which poses significant challenges for optimization. To address this, we develop efficient algorithms based on the difference-of-convex function algorithm (DCA) and the alternating direction method of multipliers (ADMM). The proposed methods decompose the original problem into tractable subproblems, leveraging closed-form proximal operators associated with the powered norm terms. We establish descent and limiting criticality properties for the DCA scheme and convergence under standard assumptions for the ADMM scheme. Extensive numerical experiments on synthetic datasets and hand gesture classification tasks demonstrate that the proposed approach achieves competitive or improved performance in anchor identification and classification accuracy compared with existing SNMF methods, while maintaining competitive computational efficiency.

矩阵分解聚类稀疏性优化算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。