arXiv:2607.24518cs.LGcs.NA2026-07

提出高效分解大规模依赖矩阵的新方法,突破百万级规模限制。

Low-Rank Dependence Decomposition via Accelerated Symmetric Non-negative Matrix Factorization

论文配图:Low-Rank Dependence Decomposition via Accelerated Symmetric Non-negative Matrix Factorization
图 1 · 摘自论文原文
  • 用迹恒等式消除稠密中间矩阵,单卡支持10万节点
  • 在10^6规模下,五种自适应梯度法仍能收敛
  • 适合金融风险建模中的长尾依赖分析,尤其适配大样本场景

对称非负矩阵分解(SymNMF)可从依赖矩阵中恢复潜在群体结构,但其密集的二次内存目标限制了以往研究在中等规模以下的应用。本文通过大规模GPU实验,评估七类算法家族(30余种配置)在极端值理论生成的绝对皮尔逊相关与尾部成对依赖矩阵上的表现,二者作为大型投资组合经验风险因子估计的代理。利用迹恒等式重构,完全消除n×n中间量,使单个GPU可达n≈10^5,多节点分布式扩展至n=10^6及以上。在两阶段流程下,十一种方法在中等规模收敛;六种在n=10^5时保持高效(五种AdaGrad族及ADMM),其中五种AdaGrad族方法在n=10^6仍可收敛:AdaGrad、RMSprop以及三种新提出的方法(分段AdaGrad、行随机SVRG、块- SVRG AdaptGrow)。在n=10^6时,最快求解器追踪矩阵谱特征:块-SVRG AdaptGrow在平坦且病态的尾部依赖谱上胜出,因其每轮开销低,适合长分解过程;全批量AdaGrad则在主导低秩相关谱上领先,因运行时间短。同时对比球面K均值作为硬标签基线:当角度聚类结构明显时更便宜,但一旦矩阵趋于单一公共因子,该方法会退化,而软分解仍具必要性。

原文摘要 · Abstract (English)

Symmetric non-negative matrix factorization (SymNMF) recovers latent group structure from a dependence matrix, but its dense, quadratic-memory objective has confined prior work to moderate sizes. We present a large-scale GPU study of seven algorithm families (over 30 configurations) on absolute Pearson correlation and tail pairwise dependence matrices from Extreme Value Theory, two proxies for empirical risk-factor estimation on large portfolios. A trace-identity reformulation eliminates all $n \times n$ intermediates, so a single GPU reaches $n \approx 10^5$ and multi-node distribution scales to $n = 10^6$ and beyond. Under a two-phase protocol, eleven methods converge at moderate scale; six remain efficient enough at $n = 10^5$ (five AdaGrad-family plus ADMM), and five AdaGrad-family methods still converge at $n = 10^6$: AdaGrad, RMSprop, and three we introduce (Piecewise AdaGrad, Row-Stochastic SVRG, Block-SVRG AdaptGrow). At $n = 10^6$ the fastest solver tracks the matrix spectrum: Block-SVRG AdaptGrow wins on the flat, ill-conditioned tail-dependence spectrum, where its lower per-iteration cost decides a long factorization, and full-batch AdaGrad wins on the dominant-low-rank correlation spectrum, where the run is short. We also benchmark spherical K-means as a hard-label baseline: cheaper when angular cluster structure is present, yet provably degenerate once the matrix collapses toward a single common factor, where the soft factorization remains necessary.

矩阵分解金融建模大模型优化深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。