用轻量采样法验证大模型推理,大幅降低证明开销。
Towards Verifiable AI with Lightweight Cryptographic Proofs of Inference
- 通过随机采样路径只公开部分执行痕迹,实现高效验证
- 证明时间从分钟级降至毫秒级,支持大规模部署
- 适合审计场景或有激励惩罚机制的可信推理需求
当大型AI模型以云服务形式部署时,客户端无法确认输出是否正确或由目标模型生成。本地重新推理对大模型不可行,而现有密码学证明系统虽能提供强正确性保证,但证明开销巨大(如百亿参数模型每查询需数百秒)。本文提出一种验证框架与协议,将完整密码学证明替换为基于神经网络统计特性的轻量采样方法。形式化论证了功能差异模型间轨迹分离的条件,可用于保障可验证推理的安全性。验证方通过梅尔克树向量承诺执行轨迹,并仅在从输出到输入的随机路径上打开少量条目。该协议以牺牲部分可靠性换取效率提升,适用于审计、大规模重复查询放大检测概率,以及存在理性激励惩罚机制的场景。实验在ResNet-18分类器和Llama-2-7B上验证,表明常见架构具备所需统计特性,且自然对抗策略(梯度重建、逆变换、对数替换)均无法逃避检测。此外,还提出一种裁判委托模型下的协议,两台竞争服务器可在对数轮次内识别正确输出。
原文摘要 · Abstract (English)
When large AI models are deployed as cloud-based services, clients have no guarantee that responses are correct or were produced by the intended model. Rerunning inference locally is infeasible for large models, and existing cryptographic proof systems -- while providing strong correctness guarantees -- introduce prohibitive prover overhead (e.g., hundreds of seconds per query for billion-parameter models). We present a verification framework and protocol that replaces full cryptographic proofs with a lightweight, sampling-based approach grounded in statistical properties of neural networks. We formalize the conditions under which trace separation between functionally dissimilar models can be leveraged to argue the security of verifiable inference protocols. The prover commits to the execution trace of inference via Merkle-tree-based vector commitments and opens only a small number of entries along randomly sampled paths from output to input. This yields a protocol that trades soundness for efficiency, a tradeoff well-suited to auditing, large-scale deployment settings where repeated queries amplify detection probability, and scenarios with rationally incentivized provers who face penalties upon detection. Our approach reduces proving times by several orders of magnitude compared to state-of-the-art cryptographic proof systems, going from the order of minutes to the order of milliseconds, with moderately larger proofs. Experiments on ResNet-18 classifiers and Llama-2-7B confirm that common architectures exhibit the statistical properties our protocol requires, and that natural adversarial strategies (gradient-descent reconstruction, inverse transforms, logit swapping) fail to produce traces that evade detection. We additionally present a protocol in the refereed delegation model, where two competing servers enable correct output identification in a logarithmic number of rounds.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。