arXiv:2509.24257cs.CRcs.LG2025-09被引 6

让大模型推理结果可公开验证,成本降为1%

VeriLLM: A Lightweight Framework for Publicly Verifiable Decentralized Inference

  • 用轻量重运行+链上最小校验,防止作弊
  • 验证成本仅需原始推理的1%,效率大幅提升
  • 同一硬件同时处理推理与验证,适合去中心化部署

去中心化推理为大语言模型(LLMs)提供了一种可扩展且具备弹性的服务范式,支持全球碎片化资源利用并降低对集中式服务商的依赖。然而,在无许可环境下缺乏可信节点时,确保模型输出正确性仍是核心挑战。我们提出 VeriLLM,一种可公开验证的去中心化 LLM 推理协议,在保证安全与激励机制的同时保持实际效率。VeriLLM 结合轻量级经验重运行与最小链上检查,杜绝搭便车行为,使验证者以约 1% 的底层推理成本完成结果验证,该优势源于预填充与自回归解码之间的结构分离。为防止验证瓶颈,我们设计了同构的推理-验证架构,将两者角色复用在相同的 GPU 工作节点上。此设计(一)提升 GPU 利用率与整体吞吐量,(二)扩大有效验证者集合,增强鲁棒性与活性,(三)强制任务不可区分性,防止节点特定优化或选择性行为。通过理论分析与系统级评估,我们证明 VeriLLM 在极低开销下实现可靠的公开可验证性,为可信且可扩展的去中心化 LLM 推理提供了实用基础。

原文摘要 · Abstract (English)

Decentralized inference provides a scalable and resilient paradigm for serving large language models (LLMs), enabling fragmented global resource utilization and reducing reliance on centralized providers. However, in a permissionless environment without trusted nodes, ensuring the correctness of model outputs remains a core challenge. We introduce VeriLLM, a publicly verifiable protocol for decentralized LLM inference that achieves security with incentive guarantees while maintaining practical efficiency. VeriLLM combines lightweight empirical rerunning with minimal on-chain checks to preclude free-riding, allowing verifiers to validate results at approximately 1% of the underlying inference cost by exploiting the structural separation between prefill and autoregressive decoding. To prevent verification bottlenecks, we design an isomorphic inference--verification architecture that multiplexes both inference and verification roles across the same GPU workers. This design (i) improves GPU utilization and overall throughput, (ii) enlarges the effective validator set, enhancing robustness and liveness, and (iii) enforces task indistinguishability to prevent node-specific optimizations or selective behavior. Through theoretical analysis and system-level evaluation, we show that VeriLLM achieves reliable public verifiability with minimal overhead, offering a practical foundation for trustworthy and scalable decentralized LLM inference.

去中心化可验证大模型推理轻量框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。