用量化梯度和默克尔证明实现可验证的机器学习挖矿
PoGO: A Scalable Proof of Useful Work via Quantized Gradient Descent and Merkle Proofs
- 用4位量化梯度降低存储与计算开销,仍保证验证可信
- 对1750亿参数的GPT-3模型验证成本仅为训练的1/10
- 适合关注区块链+AI协同验证的开发者与研究者
我们提出一种名为梯度优化证明(PoGO)的区块链共识设计,矿工需提供训练大规模机器学习模型的可验证证据。基于前期工作,采用4比特量化梯度,在降低存储与计算需求的同时,确保验证者可确认损失函数真实下降。利用默克尔证明处理32比特全模型参数,支持随机叶节点检查,上链数据极少。以拥有1750亿参数的GPT-3为例,并参考270亿参数的Gemma模型。实证分析显示,验证成本远低于训练,部分归功于量化与采样。引入有意义训练步骤需延长区块时间(可能达数小时),使用专用GPU存在权衡,二进制差分可增量优化更新。微调亦可类似处理,仅变更数据集与采样方式,保留整体验证流程。验证者可发布正/负证明,最终聚合以确认更新或惩罚矿工。
原文摘要 · Abstract (English)
We present a design called Proof of Gradient Optimization (PoGO) for blockchain consensus, where miners produce verifiable evidence of training large-scale machine-learning models. Building on previous work, we incorporate quantized gradients (4-bit precision) to reduce storage and computation requirements, while still preserving the ability of verifiers to check that real progress has been made on lowering the model's loss. Additionally, we employ Merkle proofs over the full 32-bit model to handle large parameter sets and to enable random leaf checks with minimal on-chain data. We illustrate these ideas using GPT-3 (175B parameters) as a reference example and also refer to smaller but high-performance models (e.g., Gemma~3 with 27B parameters). We provide an empirical cost analysis showing that verification is significantly cheaper than training, thanks in part to quantization and sampling. We also discuss the necessity of longer block times (potentially hours) when incorporating meaningful training steps, the trade-offs when using specialized GPU hardware, and how binary diffs may incrementally optimize updates. Finally, we note that fine-tuning can be handled in a similar manner, merely changing the dataset and the manner of sampling but preserving the overall verification flow. Our protocol allows verifiers to issue either positive or negative attestations; these are aggregated at finalization to either confirm the update or slash the miner.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。