arXiv:2602.03951cs.LGcs.CV2026-02被引 1

通过嵌入几何结构诊断模型在分布外时的鲁棒性,无需标签。

Representation Geometry as a Diagnostic for Out-of-Distribution Robustness

  • 构建类别条件的k近邻图,用谱复杂度和曲率衡量表示几何。
  • 谱复杂度低、曲率高时,模型在分布外任务上表现更好。
  • 适用于无标签场景下模型鲁棒性评估与检查点选择。

在缺乏目标域标签的情况下,模型在分布外(OOD)情形下的鲁棒泛化难以监测与优化,因为具有相似域内准确率的模型可能表现出截然不同的分布外性能。尽管先前工作聚焦于训练时正则化和低阶表示统计量,但关于学习到的嵌入几何结构是否能提供可靠的后验鲁棒性信号仍知之甚少。本文提出一种基于几何的诊断框架:从域内嵌入构建类别条件的互为k近邻图,并提取两个互补不变量——基于归一化拉普拉斯矩阵的简化对数行列式作为全局谱复杂度代理,以及基于Ollivier-Ricci曲率的局部平滑度度量。在多种架构、训练策略和噪声基准测试中,我们发现更低的谱复杂度和更高的平均曲率始终一致地预示着更强的分布外准确率。受控扰动与拓扑分析进一步表明,这些信号反映的是有意义的表示结构而非表面嵌入统计量。结果表明,表示几何可实现可解释、无需标签的鲁棒性诊断,并支持在分布偏移下可靠地进行无监督检查点选择。

原文摘要 · Abstract (English)

Robust generalization under distribution shift remains difficult to monitor and optimize in the absence of target-domain labels, as models with similar in-distribution accuracy can exhibit markedly different out-of-distribution (OOD) performance. While prior work has focused on training-time regularization and low-order representation statistics, little is known about whether the geometric structure of learned embeddings provides reliable post-hoc signals of robustness. We propose a geometry-based diagnostic framework that constructs class-conditional mutual k-nearest-neighbor graphs from in-distribution embeddings and extracts two complementary invariants: a global spectral complexity proxy based on the reduced log-determinant of the normalized Laplacian, and a local smoothness measure based on Ollivier--Ricci curvature. Across multiple architectures, training regimes, and corruption benchmarks, we find that lower spectral complexity and higher mean curvature consistently predict stronger OOD accuracy across checkpoints. Controlled perturbations and topological analyses further show that these signals reflect meaningful representation structure rather than superficial embedding statistics. Our results demonstrate that representation geometry enables interpretable, label-free robustness diagnosis and supports reliable unsupervised checkpoint selection under distribution shift.

鲁棒性诊断表示几何分布外无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。