arXiv:2506.16032cs.LGeess.SP2025-06被引 10

提出可扩展的高阶张量恢复因子化方法,实现高效收敛。

A Scalable Factorization Approach for High-Order Structured Tensor Recovery

  • 在正交约束下用Riemannian梯度下降优化张量因子
  • 证明了在合理初始化下线性收敛至真实张量
  • 适用于高阶张量,计算复杂度随阶数多项式增长

张量分解通过将$N$阶张量表示为约$N$个低维因子,显著减少参数量,对高阶张量尤其有效,因其元素数量随阶数指数增长。在信号恢复与数据分析中广泛应用。本文提出统一框架,基于张量分解的典范形式(多数因子正交以消除尺度歧义),采用Riemannian梯度下降(RGD)在Stiefel流形上优化这些正交因子。在损失函数满足弱条件下,建立了因子化目标的Riemannian正则性条件,并证明当初始值合适时,RGD以线性速率收敛至真实张量。值得注意的是,初始化要求和收敛速率均随$N$多项式增长,优于现有对Tucker和张量列车格式的结果。

原文摘要 · Abstract (English)

Tensor decompositions, which represent an $N$-order tensor using approximately $N$ factors of much smaller dimensions, can significantly reduce the number of parameters. This is particularly beneficial for high-order tensors, as the number of entries in a tensor grows exponentially with the order. Consequently, they are widely used in signal recovery and data analysis across domains such as signal processing, machine learning, and quantum physics. A computationally and memory-efficient approach to these problems is to optimize directly over the factors using local search algorithms such as gradient descent, a strategy known as the factorization approach in matrix and tensor optimization. However, the resulting optimization problems are highly nonconvex due to the multiplicative interactions between factors, posing significant challenges for convergence analysis and recovery guarantees. In this paper, we present a unified framework for the factorization approach to solving various tensor decomposition problems. Specifically, by leveraging the canonical form of tensor decompositions--where most factors are constrained to be orthonormal to mitigate scaling ambiguity--we apply Riemannian gradient descent (RGD) to optimize these orthonormal factors on the Stiefel manifold. Under a mild condition on the loss function, we establish a Riemannian regularity condition for the factorized objective and prove that RGD converges to the ground-truth tensor at a linear rate when properly initialized. Notably, both the initialization requirement and the convergence rate scale polynomially rather than exponentially with $N$, improving upon existing results for Tucker and tensor-train format tensors.

张量分解优化算法高阶数据收敛分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。