让XGBoost训练过程可验证,保护数据和模型隐私。
ZKBoost: Zero-Knowledge Verifiable Training for XGBoost
- 用零知识证明重构XGBoost训练流程,避免直接重复计算
- 在真实数据集上精度损失小于1%,保持模型效果
- 解决旧方法的拓扑泄露和欺骗漏洞,适合高安全场景
梯度提升决策树(尤其是XGBoost)是处理表格数据最有效的方法之一。随着其在敏感场景中的部署增加,确保模型完整性的密码学保障变得至关重要。我们提出ZKBoost,首个针对XGBoost的零知识证明训练协议(zkPoT),使模型所有者可在不泄露数据或模型参数的前提下,证明其在承诺数据集上的正确训练。直接在零知识中重执行XGBoost训练成本过高,主要源于训练样本的盲分区和未知的树分裂。此外,先前关于训练与推理的零知识证明存在细微安全问题,如树结构泄露及允许模型提供者偏离正确执行的完整性漏洞。我们提出两大改进:(1) 一个通用的XGBoost zkPoT模板,可适配任意通用零知识证明后端,显著降低证明者开销;(2) 基于VOLE的实例化方案,在极低成本下解决了此前方法的安全缺陷。为最大化效率,我们开发了定点版XGBoost,特别适合高效零知识证明实现,并在真实数据集上显示其精度与标准XGBoost相差不超过1%。
原文摘要 · Abstract (English)
Gradient boosted decision trees, particularly XGBoost, are among the most effective methods for tabular data. As deployment in sensitive settings increases, cryptographic guarantees of model integrity become essential. We present ZKBoost, the first zero-knowledge proof of training (zkPoT) protocol for XGBoost, enabling model owners to prove correct training on a committed dataset without revealing data or model parameters. Naively re-executing XGBoost training in ZK would incur prohibitive costs, primarily due to the oblivious partitioning of training samples and unknown tree splits. Moreover, previous work on ZKP of training and inference had subtle security issues, such as leakage of tree topology and soundness gaps allowing cheating model providers to deviate from the correct execution of training and inference. We make two key contributions to address these challenges: (1) a generic zkPoT template for XGBoost that can be instantiated with any general-purpose ZKP backend, significantly improving prover costs compared to naive re-execution of the training process; and (2) a VOLE-based instantiation that overcomes the security issues of previous ZK proofs of training at minimal costs. To maximize efficiency, we develop a fixed-point version of XGBoost, which is particularly well suited for efficient instantiation of ZKP, and show it matches standard XGBoost accuracy to within 1\% on real-world datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。