arXiv:2502.21240cs.DScs.CC2025-02NeurIPS被引 11

结构化矩阵让向量乘法提速,解释了理论与实践的差距。

The Structural Complexity of Matrix-Vector Multiplication

  • 针对低VC维布尔矩阵,预处理后查询可快至n^{2-1/d}时间
  • 真实数据多具低VC维,解释了实际中算法远快于理论下界的原因
  • 首次在高精度场景下实现图问题的亚二次维护,适合结构化数据应用

我们研究预处理n×n矩阵并支持任意向量查询其矩阵-向量乘积的问题。尽管实践中存在高效算法,理论却表明最坏情况下无法突破朴素乘法的复杂度。此下界甚至在平均情况也成立,无法解释理论与实践的差距。因此我们关注结构化矩阵:对VC维为d的n×n布尔矩阵,可实现˜O(n²)预处理和˜O(n^{2-1/d})查询时间。由于真实数据普遍具有低常数级VC维,该结果解释了实际加速现象。进一步将结果拓展至非布尔情形,使用Pollard伪维数。我们的工作首次为诸多应用提供了非平凡上界。此前基于在线矩阵-向量(OMv)假设的条件性下界,证明了在节点增删下无法在亚二次时间内维护有效电阻、拉普拉斯求解器、最短路径和三角检测等高精度估计。但通过归约到本结果,我们展示了当输入结构化时,这些问题可高效维护,首次在高精度下获得亚二次上界。

原文摘要 · Abstract (English)

We consider the problem of preprocessing an $n\times n$ matrix $\mathbf{M}$, and supporting queries that, for any vector $v$, returns the matrix-vector product $\mathbf{M} v$. This problem has been extensively studied in both theory and practice: on one side, practitioners have developed algorithms that are highly efficient in practice, whereas on the other side, theoreticians have proven that the problem cannot be solved faster than naive multiplication in the worst-case. This lower bound holds even in the average-case, implying that existing average-case analyses cannot explain this gap between theory and practice. Hence, we study the problem for \emph{structured} matrices. We show that for $n\times n$ Boolean matrices of VC-dimension $d$, the matrix-vector multiplication problem can be solved with $\widetilde{O}(n^2)$ preprocessing and $\widetilde{O}(n^{2-1/d})$ query time. Given the low constant VC-dimensions observed in most real-world data, our results posit an explanation for why the problem can be solved so much faster in practice. Furthermore, we show how to extend this result to the non-Boolean setting with the Pollard pseudodimension. Our results yield the first non-trivial upper bounds for many applications. In previous works, the online matrix-vector (OMv) hypothesis (conjecturing that quadratic time is needed per query, even over the boolean semi-ring) was used to prove many conditional lower bounds, showing that it is impossible to compute and maintain high-accuracy estimates for effective resistance, Laplacian solvers, shortest paths, and triangle detection in graphs subject to node insertions and deletions in subquadratic time. Yet, via a reduction to our matrix-vector multiplication result, we show we can maintain these problems efficiently if the input is structured, providing the first subquadratic upper bounds in the high-accuracy regime.

矩阵乘法结构化数据算法复杂度图算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。