arXiv:2605.23410cs.LGcs.CV2026-05中稿 · ICML

多视角探针揭示模型权重中的深层关联,提升模型识别精度

What Linear Probes Miss: Multi-View Probing for Weight-Space Learning

论文配图:What Linear Probes Miss: Multi-View Probing for Weight-Space Learning
图 1 · 摘自论文原文
  • 设计多视角探针框架,融合一阶信号与行列交互特征
  • 在Model Jungle上对多种模型实现超越ProbeX的识别性能
  • 适合研究模型相似性、权重空间分析的开发者与研究人员

开源模型库的爆发式增长催生了“模型丛林”,其中检查点常缺乏文档和元数据。尽管权重空间学习可直接从参数中分析模型,但处理全规模权重计算开销过大。探针方法作为轻量替代,通过可学习探针向量提取置换等变表示。然而现有方法受限于单视角设计:仅捕捉一阶结构,无法编码行-列交互中的高阶相关模式。为此,我们提出MVProbe,一种多视角探针框架,融合一阶信号与基于格拉姆矩阵的交互感知视图。该方法理论严谨,通过分析不同探针阶数的缩放规律,推导出平衡各分支贡献的标准化与融合策略。在Model Jungle基准测试中,MVProbe在多种架构(包括判别型主干网络如ResNet、SupViT、MAE、DINO,以及大规模生成式LoRA适配器Stable Diffusion LoRA)上均持续优于当前最优的ProbeX。

原文摘要 · Abstract (English)

The explosive growth of open-source model repositories has created a Model Jungle, where checkpoints are frequently shared without adequate documentation or metadata. While weight-space learning offers a pathway to identify and analyze these models directly from their parameters, processing full-scale weights is computationally prohibitive. Probing-based methods have emerged as a lightweight alternative, extracting permutation-equivariant representations via learnable probe vectors. However, existing probing methods are limited by a single-view design: they capture first-order structures but fail to encode the rich, higher-order correlation patterns inherent in row-column interactions. To bridge this gap, we introduce MVProbe, a multi-perspective probing framework that synthesizes first-order signals with interaction-aware (Gram-based) views. Our approach is theoretically grounded; we analyze the scaling laws of different probing orders to derive a principled standardization and fusion strategy that ensures balanced contributions from all branches. On the Model Jungle benchmark, MVProbe consistently outperforms the state-of-the-art ProbeX across diverse architectures, including discriminative backbones (ResNet, SupViT, MAE, DINO) and large-scale generative LoRA adapters (Stable Diffusion LoRA).

权重空间模型识别多视角探针模型丛林

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。