arXiv:2601.22977cs.AI2026-01

提出新方法量化异构模型生态中模型的独特性,解决冗余识别难题。

Quantifying Model Uniqueness in Heterogeneous AI Ecosystems

  • 通过可控干预分离模型内在特性,用不可还原残差衡量独特性。
  • 理论证明观测数据无法识别唯一性,需主动干预才能审计。
  • 适用于视觉、语言及交通预测等多类模型,适合监管与治理场景。

随着AI系统从孤立预测器演变为由基础模型和专用适配器构成的复杂异构生态,区分真正的行为新颖性与功能冗余成为关键治理挑战。本文提出基于仿真准实验设计(ISQED)的统计审计框架,通过在模型间施加匹配干预,分离出模型固有身份,并将独特性量化为同行不可表达残差(PIER),即目标行为中无法被任何随机凸组合所还原的部分;当PIER趋近于零时,表明可通过路由替代实现功能等价。我们提出三大核心贡献:第一,证明仅依赖观测日志时,独特性在数学上不可识别,必须控制干预;第二,推导出主动审计的缩放律,证明自适应查询协议达到最小最大样本效率($dσ^2γ^{-2}"log(Nd/δ)$);第三,揭示合作博弈方法如谢林值根本无法检测冗余。我们通过DISCO(设计集成合成控制)估计器实现该框架,并在包括计算机视觉模型(ResNet/ConvNeXt/ViT)、大语言模型(BERT/RoBERTa)以及城市级交通预测器在内的多样化生态中部署验证。该工作推动可信AI超越单模型解释,建立起基于干预的异构模型生态审计与治理的科学基础。

原文摘要 · Abstract (English)

As AI systems evolve from isolated predictors into complex, heterogeneous ecosystems of foundation models and specialized adapters, distinguishing genuine behavioral novelty from functional redundancy becomes a critical governance challenge. Here, we introduce a statistical framework for auditing model uniqueness based on In-Silico Quasi-Experimental Design (ISQED). By enforcing matched interventions across models, we isolate intrinsic model identity and quantify uniqueness as the Peer-Inexpressible Residual (PIER), i.e. the component of a target's behavior strictly irreducible to any stochastic convex combination of its peers, with vanishing PIER characterizing when such a routing-based substitution becomes possible. We establish the theoretical foundations of ecosystem auditing through three key contributions. First, we prove a fundamental limitation of observational logs: uniqueness is mathematically non-identifiable without intervention control. Second, we derive a scaling law for active auditing, showing that our adaptive query protocol achieves minimax-optimal sample efficiency ($dσ^2γ^{-2}\log(Nd/δ)$). Third, we demonstrate that cooperative game-theoretic methods, such as Shapley values, fundamentally fail to detect redundancy. We implement this framework via the DISCO (Design-Integrated Synthetic Control) estimator and deploy it across diverse ecosystems, including computer vision models (ResNet/ConvNeXt/ViT), large language models (BERT/RoBERTa), and city-scale traffic forecasters. These results move trustworthy AI beyond explaining single models: they establish a principled, intervention-based science of auditing and governing heterogeneous model ecosystems.

模型审计异构生态独特性量化干预实验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。