无需目标数据,仅用源域表示就能选出更鲁棒的模型检查点。
TopoGeoScore: A Self-Supervised Source-Only Geometric Framework for OOD Checkpoint Selection

- 基于源域嵌入构建几何图,提取全局复杂度、局部规则性和拓扑一致性信号。
- 自监督学习自动优化得分权重,在多个数据集上显著提升鲁棒检查点识别率。
- 适合部署前无标签目标数据时的模型可靠性评估,尤其适用于分布外场景。
当目标域标签不可用时,分布外(OOD)鲁棒性难以诊断。本文考虑一种更严格的无监督准确率估计变体:仅使用源域表示选择鲁棒检查点,不依赖任何目标样本或标签。我们提出 extbf{TopoGeoScore},一种无需标签的源域几何评分框架。给定训练好的检查点,从源域嵌入构建类条件互 $k$-近邻图,提取三个可解释信号:受扭率启发的简化拉普拉斯行列式对数(衡量全局类流形复杂度)、Ollivier--Ricci 曲率(衡量局部邻域规则性)、高阶拓扑摘要(捕捉碎片化连接、环结构及全局-局部不一致)。通过自监督目标学习非负线性组合得分,该目标强制在近似保几何的嵌入视图下保持不变,并与破坏结构的视图分离。该方法不使用目标域样本或标签,仍具可解释性。在 CIFAR 基础的噪声与分布偏移基准、ImageNet-C、MNLI→HANS 迁移任务以及 OGBN-Arxiv 上的结果表明,源域表示中蕴含可量化的全局-局部-拓扑鲁棒性证据,支持在分布偏移条件下部署前进行有效的检查点选择。
原文摘要 · Abstract (English)
Out-of-distribution (OOD) robustness is difficult to diagnose when target-domain labels are unavailable. We consider a more restrictive source-only variant of unsupervised accuracy estimation: selecting robust checkpoints using only source-domain representations, with no target samples or target labels. We propose \textbf{TopoGeoScore}, a source-only geometric scorer for label-free OOD checkpoint selection. Given a trained checkpoint, we construct class-conditional mutual $k$-nearest-neighbour graphs from source embeddings and extract three interpretable signals: a torsion-inspired reduced Laplacian log-determinant for global class-manifold complexity, Ollivier--Ricci curvature for local neighbourhood regularity, and higher-order topological summaries for fragmented connectivity, loops, and global--local inconsistency. Instead of fixing their weights by hand, TopoGeoScore learns a non-negative linear score through a self-supervised objective that enforces invariance under approximately geometry-preserving embedding views and separation from structure-breaking views. The score remains interpretable and uses no target-domain samples or labels. Results across CIFAR-based corruption and distribution-shift benchmarks, ImageNet-C, MNLI$\to$HANS transfer, and OGBN-Arxiv suggest that source representations contain measurable global--local--topological evidence of robustness, supporting practical checkpoint selection before deployment under distribution shift.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。