arXiv:2605.02111cs.LGmath.DG2026-05被引 1

通过几何与谱对齐,为神经网络层间传输提供可验证的稳定性保证。

Geometric and Spectral Alignment for Deep Neural Network II

  • 基于截断奇异子空间传输构建物理通道矩阵分解框架。
  • 给出误差界与证书半径,确保层间激活支持集不变。
  • 适用于深度卷积、语言模型等结构的稳定性分析与验证。

本文发展了残差雅可比链的几何与谱对齐中的角度与静态通道分量。从Cartan坐标刚性与拟合有效秩窗口出发,研究主导奇异子空间在相邻层间的传输机制,并将所得有限矩阵映射至物理通道坐标。主要结果为确定性且带边际验证:给出了完整接口传输与其主导窗口截断之间的误差上界;引入拟合尾部误差,使经验谱可被吉布斯-卡坦尾部模型认证;区分源模激发与全物理输入输出通道激发。给定行组与活跃支撑后,物理对齐矩阵可正交分解为核心、重叠与噪声三部分。活跃列间隙、成对重叠裕度与噪声界共同构成静态证书半径,在此范围内,完整传输与截断传输保持相同的活跃支撑、成对关联图、奇异右子空间集、枢纽列及核心/重叠/噪声掩码。不变通道映射的细粒度标签(SC/SA/ST)需额外满足行能量与轮廓相关性裕度,以显式扰动测试形式给出。实证部分报告了跨卷积网络、语言模型及视觉/扩散主干的矩阵与块能热图,用以测量这些证书量。图示为有限维测量;完全属于物理GSA证书域需验证第10节所述数值裕度协议。

原文摘要 · Abstract (English)

This paper develops the angular and static-channel component of Geometric and Spectral Alignment for residual Jacobian chains. Starting from Cartan-coordinate rigidity and fitted effective-rank windows, we study how dominant singular subspaces are transported across adjacent layers and how the resulting finite matrices can be displayed in physical channel coordinates. The main results are deterministic, margin-verified results. We bound the error between full interface transport and its dominant-window truncation, add fitted-tail errors so that empirical spectra can be certified against the Gibbs--Cartan tail model, and distinguish source-mode incidence from fully physical input-output channel incidence. Given row groups and active supports, the Physical Alignment Matrix decomposes orthogonally as core plus overlap plus noise. Active-column gaps, pairwise overlap margins, and noise bounds combine into a static certificate radius under which the full transport and the truncated transport induce the same active supports, pairwise incidence graph, SRS sets, hub columns, and core/overlap/noise masks. The finer SC/SA/ST labels of the Invariant Channel Mapping require additional row-energy and profile-correlation margins, stated as explicit perturbation tests. The empirical section reports the matrices and block-energy heatmaps that measure these certificate quantities across CNNs, language models, and vision/diffusion backbones. The figures are interpreted as finite-dimensional measurements; complete membership in the Physical GSA certificate domain requires checking the numerical margin protocol stated in Section 10.

神经网络分析谱对齐稳定性验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。