让模型推理更快更安全,把编码器放外面也不怕泄露
Gecko: Fast Private Inference via Secure Public Encoder Offloading

- 用冻结的主干网络+快速投影+私有门控压缩特征
- 推理快至0.4-2.2秒,通信量≤10.8MB,精度接近迁移学习
- 防止外部编码器被滥用,适合隐私敏感场景
私有推理在保护用户输入和服务器模型方面至关重要,但现有方案效率过低难以实用。为此,近期研究将公开编码器(如预训练主干)置于保护边界外,仅对小型私有预测器进行加密计算。然而该设计存在安全隐患:若直接外挂公共编码器,攻击者可能通过特征空间捷径更易提取私有预测器的特征到输出映射关系。本文提出Gecko,通过冻结主干网络生成分层特征,固定Fastfood投影压缩特征,并引入私有特征门控准备预测输入。我们形式化了理想独立性与信息保全条件作为设计准则,并分别评估组件复用型提取攻击。在图像与音频任务中,Gecko实现0.4–2.2秒推理,通信量不超过10.8MB,且精度与迁移学习基线相当。在所评估攻击下,复用外挂编码器并未给模型提取攻击者带来显著优势。源代码与演示见https://github.com/CassiniHuy/gecko-infer。
原文摘要 · Abstract (English)
Private inference protects both user inputs and server models during neural network inference, but existing solutions remain too slow for practical deployment. This motivates recent efforts to run a public encoder, such as a pretrained backbone, outside the protection boundary and evaluate only a small private predictor cryptographically. While appealing for efficiency, this design is not inherently secure: naively offloading a public encoder may create a feature-space shortcut: an extraction adversary may learn the remaining private predictor's feature-to-output mapping more easily than the original model's input-to-output behavior. We present Gecko, designed to limit this additional risk while retaining a compact encrypted predictor. We leverage a frozen backbone that contributes hierarchical features, fixed Fastfood projections that compress them, and private feature gating that prepares them for prediction. We formalize ideal independence and information-preservation conditions as design guidance, then separately evaluate component-reuse extraction attacks. Across image and audio tasks, Gecko achieves 0.4-2.2 second inference with at most 10.8 MB communication and accuracy comparable to transfer-learning baselines. Under the evaluated attacks, reusing the offloaded public encoder provides no significant advantage to model-extraction adversaries. Source code and a demo are available at https://github.com/CassiniHuy/gecko-infer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。