arXiv:2509.24171cs.LG2025-09被引 2

通过随机选择探测实现模型关联性精准检测,无需参数访问。

Model Correlation Detection via Random Selection Probing

  • 构建统计检验框架,用随机选择任务测试模型间转移能力
  • 相关模型检测出极小p值,无关模型保持高p值,准确率高
  • 适用于大语言和视觉语言模型,适合模型溯源与版权保护

大型语言模型(LLMs)和视觉语言模型(VLMs)的普及加剧了对可靠技术的需求,以判断一个模型是否微调自另一模型或是否完全相同。现有基于相似性的方法通常需要访问模型参数,或产生无理论依据的评分,限制了适用性。我们提出随机选择探测(RSP),一种将模型关联性检测建模为统计检验的假设检验框架。RSP在参考模型上优化文本或视觉前缀以完成随机选择任务,并评估其在目标模型上的可迁移性,生成严格的p值以量化关联证据。为减少假阳性,RSP引入无关基线模型,过滤通用可迁移特征。我们在多种参考模型和目标模型访问条件下,对LLMs和VLMs进行了评估。实验显示,对于相关模型,RSP始终产生小p值;对于无关模型,则维持高p值。大量消融研究进一步验证了RSP的鲁棒性。结果表明,RSP是首个原理严谨且通用的统计框架,可支持现代机器学习生态中透明、可解释的决策。

原文摘要 · Abstract (English)

The growing prevalence of large language models (LLMs) and vision-language models (VLMs) has heightened the need for reliable techniques to determine whether a model has been fine-tuned from or is even identical to another. Existing similarity-based methods often require access to model parameters or produce heuristic scores without principled thresholds, limiting their applicability. We introduce Random Selection Probing (RSP), a hypothesis-testing framework that formulates model correlation detection as a statistical test. RSP optimizes textual or visual prefixes on a reference model for a random selection task and evaluates their transferability to a target model, producing rigorous p-values that quantify evidence of correlation. To mitigate false positives, RSP incorporates an unrelated baseline model to filter out generic, transferable features. We evaluate RSP across both LLMs and VLMs under diverse access conditions for reference models and test models. Experiments on fine-tuned and open-source models show that RSP consistently yields small p-values for related models while maintaining high p-values for unrelated ones. Extensive ablation studies further demonstrate the robustness of RSP. These results establish RSP as the first principled and general statistical framework for model correlation detection, enabling transparent and interpretable decisions in modern machine learning ecosystems.

模型检测统计检验大模型溯源

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。