arXiv:2603.09601cs.LGstat.ME2026-03

提出适用于复杂数据的非负矩阵分解新算法,提升特征提取准确性。

MM-algorithms for traditional and convex NMF with Tweedie and Negative Binomial cost functions and empirical evaluation

  • 基于极大化极小化框架,推导多种分布下的乘法更新规则。
  • 在突变和词频数据上验证,噪声模型选择显著影响特征恢复效果。
  • 首次实现凸NMF的泊松与负二项模型,适合大规模类别场景。

非负矩阵分解(NMF)是广泛用于无监督学习和特征提取的工具,应用涵盖基因组学、文本分析和信号处理。传统NMF通常基于高斯或泊松噪声假设,可能无法适应具有过度离散性或复杂均值-方差关系的数据。本文提出一个统一框架,支持传统与凸NMF在广义分布假设下(包括负二项分布和Tweedie模型)的建模,揭示了Tweedie分布与β-散度之间的关联。通过极大化极小化方法,推导出所有模型的乘法更新规则,并提出凸NMF在泊松与负二项成本函数下的新更新方式。实现所有模型的统一代码,包含多个首次实现的凸NMF模型。在突变数据和词频数据上的实证评估表明,噪声模型的选择显著影响模型拟合与特征恢复效果;凸NMF在类别数较大时可作为高效稳健的传统NMF替代方案。代码已开源至R包nmfgenr,地址:https://github.com/MartaPelizzola/nmfgenr。

原文摘要 · Abstract (English)

Non-negative matrix factorisation (NMF) is a widely used tool for unsupervised learning and feature extraction, with applications ranging from genomics to text analysis and signal processing. Standard formulations of NMF are typically derived under Gaussian or Poisson noise assumptions, which may be inadequate for data exhibiting overdispersion or other complex mean-variance relationships. In this paper, we develop a unified framework for both traditional and convex NMF under a broad class of distributional assumptions, including Negative Binomial and Tweedie models, where the connection between the Tweedie and the $β$-divergence is also highlighted. Using a Majorize-Minimisation approach, we derive multiplicative update rules for all considered models, and novel updates for convex NMF with Poisson and Negative Binomial cost functions. We provide a unified implementation of all considered models, including the first implementations of several convex NMF models. Empirical evaluations on mutational and word count data demonstrate that the choice of noise model critically affects model fit and feature recovery, and that convex NMF can provide an efficient and robust alternative to traditional NMF in scenarios where the number of classes is large. The code for our proposed updates is available in the R package nmfgenr and can be found at https://github.com/MartaPelizzola/nmfgenr.

非负矩阵分解统计建模机器学习数据降维

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。