用张量分解向量提升大规模矩阵迹估计效率
Stochastic trace estimation with tensor train random vectors
- 提出张量训练随机向量作为结构化测试向量
- 当张量秩≥维度-1时,误差依赖与维度无关
- 适合处理高阶张量数据的高效迹估计
随机迹估计是通过矩阵-向量乘法估算大规模矩阵迹的标准方法。但在张量结构场景中,传统高斯或Rademacher测试向量存储与计算成本过高,而廉价的一阶张量积向量的样本复杂度随张量阶数呈指数增长。本文研究高斯随机张量训练向量作为结构化替代方案。我们证明:在合适张量训练秩下,该方法可恢复Girard--Hutchinson估计器的维度无关保证。特别是,中位数-均值变体在张量训练秩 $r \geq d-1$ 时,达到与无结构高斯向量经典估计器相同的精度 $\varepsilon$ 和失败概率 $δ$ 依赖关系。进一步证明:由独立高斯随机张量训练向量构成的压缩映射,当 $r\geq d-1$ 且样本数为 $\mathcal{O}(\varepsilon^{-2}(k+\log(1/δ)))$ 时,足以嵌入 $k$ 维目标子空间。最后,我们将此类压缩映射用于Nyström++框架,证明在额外谱尾条件下,估计器可实现 $\mathcal{O}(\varepsilon^{-1})$ 样本复杂度。这些结果澄清了随机张量训练向量在随机迹估计中的潜力与局限。
原文摘要 · Abstract (English)
Stochastic trace estimation is a standard tool for approximating the trace of a large-scale matrix available only through matrix-vector products. However, in tensor-structured settings, unstructured Gaussian or Rademacher test vectors may be prohibitively expensive to store and compute with, while cheaper rank-one tensor-product vectors can require sample complexities that grow exponentially with the tensor order. This work studies Gaussian random tensor train vectors as a structured alternative for stochastic trace estimation. We show that, with a suitable choice of the tensor train rank, random tensor train vectors recover dimension-independent guarantees for the Girard--Hutchinson estimator. In particular, a median-of-means variant with tensor train rank $r \geq d-1$ achieves the same dependence on the accuracy $\varepsilon$ and failure probability $δ$ as the classical estimator based on unstructured Gaussian vectors. We further prove an oblivious subspace injection result for sketches formed from independent Gaussian random tensor train vectors: tensor train rank $r\geq d-1$ and $\mathcal{O}(\varepsilon^{-2}(k+\log(1/δ)))$ samples suffice for a $k$-dimensional target subspace. Finally, we investigate the use of such sketches within the Nyström++ framework. We show that the resulting estimator can achieve the desired $\mathcal{O}(\varepsilon^{-1})$ sample complexity under an additional spectral-tail condition. These results provide clarififcation on both the potential and the limitations of random tensor train vectors in stochastic trace estimation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。