arXiv:2608.29111cs.CRcs.AI2026-08

提出CoVeil防御机制,降低云边协同解码的隐私泄露风险。

Auditing and Mitigating Privacy Leakage in Cloud-Edge Collaborative Decoding

论文配图:Auditing and Mitigating Privacy Leakage in Cloud-Edge Collaborative Decoding
图 1 · 摘自论文原文
  • 动态优化传输信号,实时抑制隐私泄露
  • 隐私泄露降低最高达87.2%,准确率损失极小
  • 适合部署在资源受限设备上的私密数据处理场景

个性化助手和专有文档分析等应用需要大语言模型(LLM)基于私密数据生成输出。然而,强大的LLM通常无法部署在存储私密数据的资源受限设备上,而将私密数据上传至云端的LLM又存在敏感信息暴露风险。近期工作采用云边协同解码范式:私密数据保留在边缘,由小型语言模型(SLM)生成下一个词的概率分布,并与仅基于公开数据的云端LLM预测结果融合。本文通过构建QA数据集,提出新颖评估框架,系统分析该范式的隐私风险,发现此类协作可能暴露大量私密上下文信息。为此,我们提出CoVeil防御机制,在解码过程中动态优化传输信号,抑制泄露同时保持协作质量。大量实验表明,CoVeil在多个基准上持续提升隐私-效用权衡,数据泄露最高减少87.2%,准确率损失微乎其微。

原文摘要 · Abstract (English)

Applications such as personalized assistance and proprietary document analysis require large language models (LLMs) to generate outputs from private data. Yet powerful LLMs typically cannot be deployed on the resource-constrained devices where private data resides, and uploading private data to cloud-hosted LLMs exposes sensitive information. Recent work addresses this tension with a cloud-edge collaborative decoding paradigm, where private data are kept on the edge with a small language model (SLM) producing next-token distributions, which are fused with predictions from a cloud LLM operating solely on public data. In this paper, we systematically analyze the privacy risks of such a paradigm with a novel evaluation framework using constructed QA datasets, which show that such collaboration can expose substantial private-context information. To address such privacy leakage, we propose CoVeil, a defense mechanism which dynamically optimizes transmitted signals to suppress leakage during decoding time while preserving the collaborative quality. Extensive evaluations demonstrate that CoVeil consistently improves the privacy-utility trade-off over existing baselines by reducing data leakage by up to 87.2%, with minimal accuracy loss.

隐私保护云边协同LLM安全防御机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。