arXiv:2601.09173cs.LGcs.CL2026-01被引 4

提出几何稳定性度量,揭示模型表示在坐标旋转下的结构可靠性。

Geometric Stability: The Missing Axis of Representations

  • 用互补随机子集构建相似性矩阵,通过相关性衡量表示的几何稳定性。
  • 在2463种配置中,几何稳定性与对齐度呈负相关(ρ=-0.47),压缩时差异显著。
  • 适用于评估模型可解释性、微调和对抗鲁棒性等任务中的表示可靠性。

表示相似性分析等方法仅衡量神经网络内部空间间的对齐程度,忽略了表示结构是否可稳定恢复这一关键问题。本文提出几何稳定性这一新维度,并引入 extit{Shesha}度量,通过将特征维度随机分为互补两部分,构建差异矩阵并计算其相关性,从而从单一表示中量化稳定性。与CKA和Procrustes距离不同,Shesha对特征基的正交旋转敏感,这正是设计意图:因为探测、插值和操控操作依赖于具体坐标,而旋转不变度量无法捕捉目标结构是否经受住这些操作。双分离实验表明,移除主成分会破坏CKA但不影响Shesha,而将表示旋转至特征基虽保持谱和CKA却使Shesha崩溃。在七个领域共2,463个编码器配置中,几何稳定性与对齐度在几何保形变换下冗余,在压缩时呈负相关(ρ = -0.47)。在170个视觉模型跨6个干净数据集和38个扰动数据集的测试中,DINOv2在迁移能力上排名前二,但在5个数据集中稳定性位于底部四分之一,表现出孤立分离而非权衡关系。

原文摘要 · Abstract (English)

Representational similarity analysis and related methods compare the internal geometries of neural networks, but they measure only alignment between spaces, leaving a blind spot -- whether a representation's structure is reliably recoverable, not merely similar. We introduce geometric stability, a distinct axis, and \textit{Shesha}, a metric that quantifies it from a single representation by correlating dissimilarity matrices built from complementary random halves of the feature dimensions. Unlike CKA and Procrustes distance, Shesha is provably non-invariant to orthogonal rotations of the feature basis. This is by design: the basis is privileged for learned models, since probes, patching, and steering act on coordinates, and a rotation-invariant metric cannot see whether the targeted structure survives them. A double dissociation isolates the mechanism -- removing the top principal component collapses CKA while Shesha holds, whereas rotating a representation into its eigenbasis, which preserves the spectrum and CKA exactly, collapses Shesha. Across 2,463 encoder configurations in seven domains, the metrics are redundant under geometry-preserving transforms and anti-correlate under compression ($ρ=-0.47$). Across 170 vision models spanning 6 clean and 38 corruption-shifted datasets, DINOv2 ranks first or second in transferability on three of six clean datasets yet bottom-quartile in stability on five, an isolated dissociation rather than a trade-off.

表示学习几何稳定性模型可解释性神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。