arXiv:2603.02729cs.LGmath.OC2026-03被引 2

小初始化让张量恢复更抗噪,误差不随过估计的秩增长

The power of small initialization in noisy low-tubal-rank tensor recovery

  • 用小初始值替代谱初始化,提升噪声下张量恢复精度
  • 理论证明误差几乎达到最优,且不受过度估计秩的影响
  • 适合做低秩张量恢复的算法研究者与实际应用开发者

我们研究在t-积框架下,从含噪线性观测中恢复一个低管秩张量 $\\(mathcal{X}_ ext{\star} \in \mathbb{R}^{n \times n \times k}$。主流方法将优化变量分解为 $\\(\mathcal{U} * \mathcal{U}^\top$,并使用因子化梯度下降(FGD)求解,通常假设 $r < R \le n$,即过参数化。但当测量受密集噪声(如高斯噪声)污染时,常用谱初始化导致恢复误差随过估计的管秩 $R$ 线性增长。本文证明:采用小初始化可使 FGD 实现近乎极小极大最优的恢复误差,即使 $R$ 显著大于真实管秩 $r$。通过四阶段分析框架,我们建立了迄今最紧的误差界,该界与 $R$ 无关。此外,我们给出理论保证:一种易用的早停策略在实践中可达到最佳效果。所有结论经仿真与真实数据实验验证。

原文摘要 · Abstract (English)

We study the problem of recovering a low-tubal-rank tensor $\mathcal{X}\_\star\in \mathbb{R}^{n \times n \times k}$ from noisy linear measurements under the t-product framework. A widely adopted strategy involves factorizing the optimization variable as $\mathcal{U} * \mathcal{U}^\top$, where $\mathcal{U} \in \mathbb{R}^{n \times R \times k}$, followed by applying factorized gradient descent (FGD) to solve the resulting optimization problem. Since the tubal-rank $r$ of the underlying tensor $\mathcal{X}_\star$ is typically unknown, this method often assumes $r < R \le n$, a regime known as over-parameterization. However, when the measurements are corrupted by some dense noise (e.g., Gaussian noise), FGD with the commonly used spectral initialization yields a recovery error that grows linearly with the over-estimated tubal-rank $R$. To address this issue, we show that using a small initialization enables FGD to achieve a nearly minimax optimal recovery error, even when the tubal-rank $R$ is significantly overestimated. Using a four-stage analytic framework, we analyze this phenomenon and establish the sharpest known error bound to date, which is independent of the overestimated tubal-rank $R$. Furthermore, we provide a theoretical guarantee showing that an easy-to-use early stopping strategy can achieve the best known result in practice. All these theoretical findings are validated through a series of simulations and real-data experiments.

张量恢复低秩优化算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。