arXiv:2603.01879cs.LGcs.AI2026-03被引 1

用几何特征提前预警模型在未知场景下的失效,比传统方法更可靠。

Diagnosing Generalization Failures from Representational Geometry Markers

  • 通过分析输入数据的几何结构,提取可预测失败的系统级指标。
  • 有效流形维度和效用下降,能提前预示跨域泛化性能变差。
  • 适用于多种模型架构与训练方式,适合模型选型与可靠性评估。

泛化能力是生物与人工智能的显著特征,但预测未见场景下的失败仍是核心挑战。传统方法多从底层机制入手,难以提供高阶预测信号。本文受医学生物标志物启发,提出自上而下的研究路径:设计网络标记来探测结构-功能关联,识别预后指标,并在真实场景中验证预测。在图像分类任务中,我们发现分布内(ID)对象流形的任务相关几何特性可稳定预测分布外(OOD)泛化表现。具体而言,有效流形维度和效用的降低,能一致预示不同架构、优化器与数据集上的弱化OOD性能。该结论应用于ImageNet预训练模型的迁移学习时,相同几何模式对OOD迁移性能的预测能力优于分布内准确率。结果表明,表示几何可揭示隐藏脆弱性,为模型选择与AI可解释性提供更稳健的指导。

原文摘要 · Abstract (English)

Generalization, the ability to perform well beyond the training context, is a hallmark of biological and artificial intelligence, yet anticipating unseen failures remains a central challenge. Conventional approaches often take a ``bottom-up'' mechanistic route by reverse-engineering interpretable features or circuits to build explanatory models. While insightful, these methods often struggle to provide the high-level, predictive signals for anticipating failure in real-world deployment. Here, we propose using a ``top-down'' approach to studying generalization failures inspired by medical biomarkers: identifying system-level measurements that serve as robust indicators of a model's future performance. Rather than mapping out detailed internal mechanisms, we systematically design and test network markers to probe structure, function links, identify prognostic indicators, and validate predictions in real-world settings. In image classification, we find that task-relevant geometric properties of in-distribution (ID) object manifolds consistently forecast poor out-of-distribution (OOD) generalization. In particular, reductions in two geometric measures, effective manifold dimensionality and utility, predict weaker OOD performance across diverse architectures, optimizers, and datasets. We apply this finding to transfer learning with ImageNet-pretrained models. We consistently find that the same geometric patterns predict OOD transfer performance more reliably than ID accuracy. This work demonstrates that representational geometry can expose hidden vulnerabilities, offering more robust guidance for model selection and AI interpretability.

泛化能力几何分析模型诊断迁移学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。