arXiv:2605.02108cs.LGmath.DG2026-05

揭示深度残差网络的谱几何结构,建立可解释的误差控制框架。

Geometric and Spectral Alignment for Deep Neural Network I

论文配图:Geometric and Spectral Alignment for Deep Neural Network I
图 1 · 摘自论文原文
  • 将层间雅可比矩阵建模为近单位变换,通过归一化分析其奇异谱分布
  • 提出幂律谱的严格数学表征,证明深度与指数漂移的定量关系
  • 提供可测量的诊断指标,适用于模型训练优化与稳定性分析

深度残差网络被建模为近单位雅可比矩阵的乘积。本文建立了对弗罗贝尼乌斯归一化层因子奇异谱的确定性商几何估计,强调归一化顶部径向卡坦坐标与拟合幂律图。满秩因子通过 $A\mapsto A^\top A$ 映射到正锥,再转化为有序特征值数据。在弗罗贝尼乌斯归一化下,精确幂律谱构成迹归一化的卡坦轨道,该轨道是秩上的吉布斯族、费雪信息线,以及具有线元 $d/4$ 倍费雪信息的布雷斯-瓦瑟斯坦曲线。主要刚性定理为松弛感知的边际不等式:接口径向振幅、非回溯松弛和符号残差变化控制拟合卡坦坐标的位移。在精确图零松弛情形下,深度-$L$ 预算导致指数漂移阶为 $(\log M)/L$;一般情况下,松弛与残差增量会增强该界。我们分离了标量顶部径向与全卡坦谱控制,后者还需布雷斯/赫林格残差变化。证明了近似幂律与度量图版本、逆下界、费雪-克莱尔/布雷斯作用量估计,以及归一化残差链的近单位展开。近单位结果验证了传输预算;图质量仍可测量。有效秩为谱能量分位数,给出有限宽度幂律尾部界和鲁棒秩窗过渡估计。经验静态权重指数轮廓作为诊断工具;完整验证还需同一算子链的接口预算、松弛与残差。

原文摘要 · Abstract (English)

Deep residual architectures are modeled as products of near-identity Jacobians. This paper proves deterministic quotient-geometric estimates for singular spectra of Frobenius-normalized layer factors, emphasizing a normalized top-radial Cartan coordinate and fitted power-law chart. Full-rank factors are mapped from $\mathrm{GL}(d)$ to the positive cone by $A\mapsto A^\top A$, then to ordered eigenvalue data. Under Frobenius normalization, exact power-law spectra form a trace-normalized Cartan orbit. This orbit is a Gibbs family on ranks, a Fisher information line, and a Bures--Wasserstein curve with line element $d/4$ times Fisher information. The main rigidity theorem is a slack-aware margin inequality: interface radial amplitude, non-backtracking slack, and signed residual variation control displacement of the fitted Cartan coordinate. In the exact-chart zero-slack case, a depth-$L$ budget gives exponent drift of order $(\log M)/L$; generally, slack and residual increments augment the bound. We separate scalar top-radial from full-Cartan spectral control, which also needs Bures/Hellinger residual variation. We prove approximate-power-law and metric-chart versions, converse lower bounds, Fisher--KL/Bures action estimates, and near-identity expansions for normalized residual chains. Near-identity results verify transport budgets; chart quality remains measurable. Effective rank is a spectral-energy quantile, giving finite-width power-law tail bounds and robust rank-window transition estimates. Empirical static-weight exponent profiles serve as diagnostics; full verification also requires interface budgets, slacks, and residuals for the same operator chain.

深度学习谱分析几何建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。