多视角探针揭示模型权重中的深层关联,提升模型识别精度
What Linear Probes Miss: Multi-View Probing for Weight-Space Learning

- 设计多视角探针框架,融合一阶信号与行列交互特征
- 在Model Jungle上对多种模型实现超越ProbeX的识别性能
- 适合研究模型相似性、权重空间分析的开发者与研究人员
开源模型库的爆发式增长催生了“模型丛林”,其中检查点常缺乏文档和元数据。尽管权重空间学习可直接从参数中分析模型,但处理全规模权重计算开销过大。探针方法作为轻量替代,通过可学习探针向量提取置换等变表示。然而现有方法受限于单视角设计:仅捕捉一阶结构,无法编码行-列交互中的高阶相关模式。为此,我们提出MVProbe,一种多视角探针框架,融合一阶信号与基于格拉姆矩阵的交互感知视图。该方法理论严谨,通过分析不同探针阶数的缩放规律,推导出平衡各分支贡献的标准化与融合策略。在Model Jungle基准测试中,MVProbe在多种架构(包括判别型主干网络如ResNet、SupViT、MAE、DINO,以及大规模生成式LoRA适配器Stable Diffusion LoRA)上均持续优于当前最优的ProbeX。
原文摘要 · Abstract (English)
The explosive growth of open-source model repositories has created a Model Jungle, where checkpoints are frequently shared without adequate documentation or metadata. While weight-space learning offers a pathway to identify and analyze these models directly from their parameters, processing full-scale weights is computationally prohibitive. Probing-based methods have emerged as a lightweight alternative, extracting permutation-equivariant representations via learnable probe vectors. However, existing probing methods are limited by a single-view design: they capture first-order structures but fail to encode the rich, higher-order correlation patterns inherent in row-column interactions. To bridge this gap, we introduce MVProbe, a multi-perspective probing framework that synthesizes first-order signals with interaction-aware (Gram-based) views. Our approach is theoretically grounded; we analyze the scaling laws of different probing orders to derive a principled standardization and fusion strategy that ensures balanced contributions from all branches. On the Model Jungle benchmark, MVProbe consistently outperforms the state-of-the-art ProbeX across diverse architectures, including discriminative backbones (ResNet, SupViT, MAE, DINO) and large-scale generative LoRA adapters (Stable Diffusion LoRA).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。