提出一种精确的零空间SVD误差分析方法,可预测噪声下奇异向量的偏差。
Compact and Infinite-Order Error Analysis for Null-Space SVD Estimation

- 基于精确公式推导最小左奇异向量误差,给出全阶级数展开
- 在高斯训练下,证明第二阶经验排名严格成立,风险均等化现象明确
- 揭示谱混叠诊断与例外点半径、BBP阈值三者独立,适合统计学习研究者
本文研究从噪声矩阵中估计零空间的问题。针对简单左零空间,首次推导出最小左奇异向量误差的精确紧凑表达式,并给出奇异值分解向量与投影算子的全阶级数展开。进一步提出固定实现的经验风险与条件总体泛化风险的紧凑截断级数形式。通过完整不变子空间推广至多维零空间。收敛半径不依赖误差图推测,而是由最近的复异常点决定——该点连接保留特征值分支与其补集。减少零度实验表明,移动此谱边界可扩大收敛半径,但提升非单调。在高斯训练且 τ≥m 条件下,对逐阶排列的零方向,证明了威沙特分裂矩阵 W 给出严格的二阶经验排序。高斯平均使小噪声与极大数据下的主导泛化风险相等;列交换定理证明各向同性信号子空间下严格期望泛化排序。对于不等尖峰,提出精确的总体重叠判据与同步99%蒙特卡洛置信证书,解释中间排序现象。六阶风险修正项改善了报告实验中的低交叉估计。这一等秩等风险现象是有限样本谱混叠的诊断指标,但其容忍交叉、异常点半径与渐近BBP阈值为三个独立量。
原文摘要 · Abstract (English)
We study null-space estimation from a noisy matrix. For a simple left null space, we first derive an exact compact expression for the error of the smallest left singular vector. We then give an all-order series for the SVD vector and projector, followed by compact and consistently truncated series forms for the fixed-realization empirical risk and conditional population generalization risk. The recursion extends to a multiple-dimensional null space by following the complete invariant subspace. The convergence radius is not inferred from an error plot: it is computed independently from the nearest complex exceptional point that joins a retained eigenvalue branch to its complement. A reduced-nullity experiment shows that moving this spectral boundary can increase the radius, although the improvement is not monotone in the retained nullity. For individually ordered null directions under Gaussian training with \(τ\geq m\), we prove that the Wishart splitting matrix \(W\) gives a strict second-order empirical ranking. Gaussian averaging equalizes the leading generalization risks at both small and very large noise, while a column-swap theorem proves strict expected generalization ranking for an isotropic signal subspace. For unequal spikes, an exact population-overlap criterion and a simultaneous \(99\%\) Monte Carlo confidence certificate explain the observed intermediate ranking. A sixth-order risk correction improves the lower-crossover estimate in the reported experiment. This equal--ranked--equal phenomenon is a finite-sample diagnostic related to spectral mixing, but its tolerance crossings, the exceptional-point radius, and the asymptotic BBP threshold are three distinct quantities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。