arXiv:2608.21607cs.LGstat.ML2026-08

通过零化负值恢复稀疏矩阵的低秩结构,提升大规模数据分析效率

Subzero matrix completion for sparse data analysis: large-scale learning of latent low-rank structure

论文配图:Subzero matrix completion for sparse data analysis: large-scale learning of latent low-rank structure
图 1 · 摘自论文原文
  • 提出随机块级交替最小二乘法,避免存储大尺寸中间矩阵
  • 在13.9万×13.9万的果蝇神经连接组数据上发现潜在低秩结构
  • 适用于神经科学等领域的超大规模稀疏数据建模

我们研究了稀疏非负矩阵是否能通过将低秩实数矩阵中的负元素置零来恢复。这种分解可能揭示了稀疏性与秩之间的数学关联;我们分析了多个具有潜在低秩结构的稀疏矩阵,并阐明其几何成因。以往算法依赖于对低秩因子的交替最小化,但需计算并存储一个与乘积同尺寸、既不稀疏也不低秩的矩阵。为此,我们开发了一种基于小块的随机交替最小二乘算法,可显著扩展至更大规模问题。同时,结合稀疏优化和定制CUDA内核进一步加速。以最新发布的果蝇(Drosphilia)连接组为例,该矩阵有139,255行139,255列,非零元素记录雌性果蝇神经系统中细胞间的突触数量。尽管奇异值谱缓慢衰减,仍表现出预测细胞类别层级结构的潜在低秩特性。

原文摘要 · Abstract (English)

We investigate when a sparse nonnegative matrix can be recovered from a real-valued matrix of much lower rank by zeroing out its negative elements. The potential for such decompositions suggests a mathematical connection between sparsity and rank; we analyze a number of sparse matrices with this latent low-rank structure and use them to illustrate the geometric origins of this connection. Previous algorithms have discovered these decompositions via an alternating minimization over the factors of a low-rank matrix, but to do so, they have also needed to compute and store another matrix, neither sparse nor low-rank, that is the size of their product. We develop a stochastic, alternating least-squares algorithm that operates on smaller blocks of this dense matrix and scales as a result to much larger problems. We also show how to further accelerate this algorithm with sparse optimizations and customized CUDA kernels. As one example, we use the algorithm to analyze the sparse matrix of synaptic weights for the recently published $\textit{Drosphilia}$ connectome. The nonzero elements of this matrix, with 139,255 rows and columns, record the number of synapses between cells in the nervous system of a female fruit fly. Despite a slowly decaying spectrum of singular values, this matrix exhibits a latent low-rank structure that is predictive of cell categories across multiple levels of specificity.

矩阵补全低秩学习稀疏数据神经连接组

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。