让大模型微调过程可验证,确保数据来源和更新可信。
Verifiable Fine-Tuning for LLMs: Zero-Knowledge Training Proofs Bound to Data Provenance and Policy
- 用零知识证明绑定数据来源与训练过程,支持公开审计。
- 在有限预算下保持模型性能,零违规执行政策配额。
- 适合需合规、去中心化部署的机构或研究者使用。
大型语言模型常通过参数高效微调进行适配,但现有发布流程对数据使用和更新计算的可信度保障不足。本文提出可验证微调协议与系统,生成简洁的零知识证明,证实发布模型源自公开初始化,并符合声明的训练方案与可审计的数据集承诺。该方法融合五项技术:第一,将数据源、预处理、许可证及每轮配额计数绑定至清单;第二,可验证采样器支持公开重放与私有索引隐藏的批量选择;第三,更新电路限制于参数高效微调,强制实现AdamW风格优化器语义,采用友证近似并明确误差预算;第四,递归聚合将每步证明合并为每轮及最终证书,验证耗时毫秒级;第五,绑定数据溯源与可选可信执行属性卡,验证代码身份与常量。在英文及双语指令混合数据上,方法在严格预算内维持模型效用,政策配额零违规,私有采样窗口无索引泄露。联邦实验表明系统兼容概率审计与带宽约束。结果表明,端到端可验证微调已具备实际可行性,适用于真实参数高效流水线,为受监管与去中心化部署填补关键信任空白。
原文摘要 · Abstract (English)
Large language models are often adapted through parameter efficient fine tuning, but current release practices provide weak assurances about what data were used and how updates were computed. We present Verifiable Fine Tuning, a protocol and system that produces succinct zero knowledge proofs that a released model was obtained from a public initialization under a declared training program and an auditable dataset commitment. The approach combines five elements. First, commitments that bind data sources, preprocessing, licenses, and per epoch quota counters to a manifest. Second, a verifiable sampler that supports public replayable and private index hiding batch selection. Third, update circuits restricted to parameter efficient fine tuning that enforce AdamW style optimizer semantics and proof friendly approximations with explicit error budgets. Fourth, recursive aggregation that folds per step proofs into per epoch and end to end certificates with millisecond verification. Fifth, provenance binding and optional trusted execution property cards that attest code identity and constants. On English and bilingual instruction mixtures, the method maintains utility within tight budgets while achieving practical proof performance. Policy quotas are enforced with zero violations, and private sampling windows show no measurable index leakage. Federated experiments demonstrate that the system composes with probabilistic audits and bandwidth constraints. These results indicate that end to end verifiable fine tuning is feasible today for real parameter efficient pipelines, closing a critical trust gap for regulated and decentralized deployments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。