用查表证明实现可验证的机器学习推理,支持设备端运行。
Jolt Atlas: Verifiable Inference via Lookup Arguments in Zero Knowledge
- 基于ONNX张量运算的查表机制,跳过传统虚拟机开销。
- 可在内存受限环境实现推理证明,支持小模型快速验证。
- 适合隐私保护和对抗性场景,无需专用硬件。
我们提出Jolt Atlas,一种零知识机器学习(zkML)框架,扩展Jolt证明系统以支持模型推理。与模拟CPU指令执行的zkVM不同,Jolt Atlas采用以查表为核心的思路,直接应用于ONNX张量操作。该计算模型省去寄存器需求,简化了内存一致性验证。此外,ONNX为开源可移植格式,便于跨框架、平台和运行时部署,无需特定框架转换。我们的查表论证结合求和校验协议,适用于现代机器学习中的非线性函数。通过神经遥传等优化手段,在保持模型精度的同时缩小查表规模,并引入多项张量级验证优化。实验表明,Jolt Atlas可在内存受限环境下完成推理证明,具备流式处理能力。同时,通过BlindFold技术实现零知识属性。相比现有zkML框架,我们实现了分类、嵌入、自动推理及小型语言模型的实际证明时间。证明结果简洁可验证,支持设备端运行,适用于隐私敏感与对抗性环境。配套工作中还探讨了其在智能代理商业与可信AI记忆等场景的应用。
原文摘要 · Abstract (English)
We present Jolt Atlas, a zero-knowledge machine learning (zkML) framework that extends the Jolt proving system to model inference. Unlike zkVMs (zero-knowledge virtual machines), which emulate CPU instruction execution, Jolt Atlas adapts Jolt's lookup-centric approach and applies it directly to ONNX tensor operations. The ONNX computational model eliminates the need for CPU registers and simplifies memory consistency verification. In addition, ONNX is an open-source, portable format, which makes it easy to share and deploy models across different frameworks, hardware platforms, and runtime environments without requiring framework-specific conversions. Our lookup arguments, which use sumcheck protocol, are well-suited for non-linear functions -- key building blocks in modern ML. We apply optimisations such as neural teleportation to reduce the size of lookup tables while preserving model accuracy, as well as several tensor-level verification optimisations detailed in this paper. We demonstrate that Jolt Atlas can prove model inference in memory-constrained environments -- a prover property commonly referred to as \textit{streaming}. Furthermore, we discuss how Jolt Atlas achieves zero-knowledge through the BlindFold technique, as introduced in Vega. In contrast to existing zkML frameworks, we show practical proving times for classification, embedding, automated reasoning, and small language models. Jolt Atlas enables cryptographic verification that can be run on-device, without specialised hardware. The resulting proofs are succinctly verifiable. This makes Jolt Atlas well-suited for privacy-centric and adversarial environments. In a companion work, we outline various use cases of Jolt Atlas, including how it serves as guardrails in agentic commerce and for trustless AI context (often referred to as \textit{AI memory}).
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。