arXiv:2602.18758cs.CRcs.AI2026-02

通过协议与算法协同优化,实现高效私有卷积神经网络推理。

UFO: Unlocking Ultra-Efficient Quantized Private Inference with Protocol and Algorithm Co-Optimization

  • 联合优化安全计算协议与量化算法,降低通信开销。
  • 相比现有框架,通信量减少3.6至11.7倍,精度提升1.16%以上。
  • 适合对隐私保护和推理效率要求高的场景,如医疗与金融。

基于安全两方计算(2PC)的私有卷积神经网络(CNN)推理面临高通信与延迟开销,尤其在卷积层。本文提出UFO,一种联合优化2PC协议与量化算法的量化2PC推理框架。UFO创新性地将高效的Winograd卷积算法与量化结合,但发现直接融合存在两大挑战:从推理角度看,Winograd变换引入大量加法运算和频繁的位宽转换,导致显著通信开销;从训练角度看,其引入权重重尾,使量化感知训练(QAT)困难,影响模型精度。为此,我们协同优化协议与算法:1)在协议层面,提出一系列图级优化以最小化通信;2)在算法层面,基于层敏感性设计混合精度QAT算法,在通信约束下优化精度;为应对重尾问题,进一步引入2PC友好的位重加权算法,在不增加位宽前提下扩展表示范围。大量实验表明,UFO相较最先进的框架SiRNN、COINN和CoPriv,分别实现11.7倍、3.6倍和6.3倍通信减少,并在精度上提升1.29%、1.16%和1.29%。

原文摘要 · Abstract (English)

Private convolutional neural network (CNN) inference based on secure two-party computation (2PC) suffers from high communication and latency overhead, especially from convolution layers. In this paper, we propose UFO, a quantized 2PC inference framework that jointly optimizes the 2PC protocols and quantization algorithm. UFO features a novel 2PC protocol that systematically combines the efficient Winograd convolution algorithm with quantization to improve inference efficiency. However, we observe that naively combining quantization and Winograd convolution faces the following challenges: 1) From the inference perspective, Winograd transformations introduce extensive additions and require frequent bit width conversions to avoid inference overflow, leading to non-negligible communication overhead; 2) From the training perspective, Winograd transformations introduce weight outliers that make quantization-aware training (QAT) difficult, resulting in inferior model accuracy. To address these challenges, we co-optimize both protocol and algorithm. 1) At the protocol level, we propose a series of graph-level optimizations for 2PC inference to minimize the communication. 2) At the algorithm level, we develop a mixed-precision QAT algorithm based on layer sensitivity to optimize model accuracy given communication constraints. To accommodate the outliers, we further introduce a 2PC-friendly bit re-weighting algorithm to increase the representation range without explicitly increasing bit widths. With extensive experiments, UFO demonstrates 11.7x, 3.6x, and 6.3x communication reduction with 1.29%, 1.16%, and 1.29% higher accuracy compared to state-of-the-art frameworks SiRNN, COINN, and CoPriv, respectively.

私有推理量化安全计算高效算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。