arXiv:2605.19325cs.LG2026-05中稿 · ICML被引 1

提出外点法eNMF,让非负矩阵分解更快更准

An Exterior Method for Nonnegative Matrix Factorization

论文配图:An Exterior Method for Nonnegative Matrix Factorization
图 1 · 摘自论文原文
  • 先解无约束问题,再旋转到非负区域,避开约束陷阱
  • 99%实验中不同算法收敛到等价解,证明解的稳定性
  • 比9大主流方法快1.5倍或误差低30%,适合音频与推荐场景

非负矩阵分解(NMF)旨在寻找非负因子的低秩近似 $X o UV^T$,传统方法依赖内点法全程强制可行性,但在非凸空间中易导致收敛慢或陷入次优驻点。本文提出外点框架eNMF,将低秩近似与非负性强制分离:从最优无约束因子出发,通过旋转操作将其映射至最接近非负象限的外部点。该视角形成算法框架,简单迭代即可收敛至正象限边界上满足KKT条件的驻点。外点形式还揭示了在置换与正交变换下的因子等价类。400组实验(含真实与合成数据)显示,99%情况下不同算法趋向等价因子矩阵。在3个真实与2个合成数据集上,对比9种先进NMF算法、9种初始化方式,共81组实验中,eNMF始终领先,在等时条件下重建误差降低最高达30%,等误差条件下提速最高达150%。下游音频处理与推荐任务实验进一步验证其实际优势。代码开源:https://github.com/roychowdhuryresearch/eNMF

原文摘要 · Abstract (English)

Nonnegative matrix factorization (NMF) seeks a low-rank approximation $X \approx UV^T$ with nonnegative factors and is commonly solved using interior methods that enforce feasibility throughout optimization. We show that such constraint-driven approaches can impede progress in the nonconvex landscape, leading to slow convergence or convergence to suboptimal stationary points. We propose an exterior framework for NMF (eNMF) that separates low-rank approximation from nonnegativity enforcement. Our method initializes from the optimal unconstrained factorization and introduces a rotation procedure that maps unconstrained factors to an exterior point closest to the nonnegative orthant. This viewpoint yields an algorithmic framework in which simple iterative updates converge to KKT-satisfying stationary points on the boundary of the positive orthant. The exterior formulation also enables a geometric interpretation of NMF solutions, clarifying equivalence classes of factorizations under permutation and orthogonal transformations. An intriguing numerical result, involving 400 NMF experiments across both real and synthetic datasets, show that in 99% of the cases, different algorithms tend to converge towards equivalent factor matrices. We benchmark eNMF against 9 state-of-the-art NMF algorithms with 9 initialization schemes across 3 real-world and 2 synthetic datasets. eNMF consistently outperforms all 81 competitors, achieving up to 30% lower reconstruction error under equal-time settings and up to 150% speedup under equal-error settings. The downstream experiments further demonstrate substantial performance gains in audio processing and recommendation tasks, corroborating the practical benefits of the proposed exterior optimization framework. Code is available at https://github.com/roychowdhuryresearch/eNMF

非负矩阵分解优化算法加速计算机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。