arXiv:2508.10866cs.LG2025-08NeurIPS被引 1

提出可验证的数据归属方法,让计算资源少的方也能信任结果。

Efficiently Verifiable Proofs of Data Attribution

  • 设计交互式证明协议,由强算力方提供数据归属,弱算力方验证。
  • 验证者只需少量模型重训练(与数据集大小无关),误差不超过ε。
  • 适用于多种归属任务,适合数据定价等关键场景使用。

数据归属方法旨在回答如‘若模型在不同数据集上训练,预测会如何变化’之类的反事实问题。然而,通过经验影响或‘datamodeling’估算数据归属仍极为耗时,导致信任难题:若仅有少数计算资源丰富的机构能获取归属结果,资源受限方如何确信这些结果可靠,尤其是在数据定价等重要下游应用中?本文提出一种交互式验证范式,解决该信任问题。一个不被信任且计算能力强的证明者学习数据归属,随后与资源受限的验证者进行交互证明。核心成果是构建了一个满足概率近似正确(PAC)验证的协议,具备形式化完备性、可靠性与效率保证。若双方遵守协议,验证者以1-δ的概率接受与最优归属相差ε(均方误差意义下)的结果;反之,即使证明者无限计算也无法规避检测,或仍需向验证者提供归属结果,失败概率不超过δ。重要的是,验证者的计算负担(独立模型重训练次数)仅随1/ε增长,与数据集规模无关。技术上,该协议可验证任何在布尔超立方体上由证明者计算的线性函数,具有广泛适用性。

原文摘要 · Abstract (English)

Data attribution methods aim to answer useful counterfactual questions like "what would a ML model's prediction be if it were trained on a different dataset?" However, estimation of data attribution models through techniques like empirical influence or "datamodeling" remains very computationally expensive. This causes a critical trust issue: if only a few computationally rich parties can obtain data attributions, how can resource-constrained parties trust that the provided attributions are indeed "good," especially when they are used for important downstream applications (e.g., data pricing)? In this paper, we address this trust issue by proposing an interactive verification paradigm for data attribution. An untrusted and computationally powerful Prover learns data attributions, and then engages in an interactive proof with a resource-constrained Verifier. Our main result is a protocol that provides formal completeness, soundness, and efficiency guarantees in the sense of Probably-Approximately-Correct (PAC) verification. Specifically, if both Prover and Verifier follow the protocol, the Verifier accepts data attributions that are ε-close to the optimal data attributions (in terms of the Mean Squared Error) with probability 1-δ. Conversely, if the Prover arbitrarily deviates from the protocol, even with infinite compute, then this is detected (or it still yields data attributions to the Verifier) except with probability δ. Importantly, our protocol ensures the Verifier's workload, measured by the number of independent model retrainings it must perform, scales only as O(1/ε); i.e., independently of the dataset size. At a technical level, our results apply to efficiently verifying any linear function over the boolean hypercube computed by the Prover, making them broadly applicable to various attribution tasks.

数据归属可验证计算交互证明可信机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。