arXiv:2605.23158cs.CRcs.CL2026-05中稿 · ACM CCS'26

揭示大模型分片推理中的隐私泄露风险,提出可重建输入的攻击方法

What Does the Server See? Understanding Privacy Leakage from Large Language Models in Split Inference

论文配图:What Does the Server See? Understanding Privacy Leakage from Large Language Models in Split Inference
图 1 · 摘自论文原文
  • 通过匹配中间激活实现客户端输入重构,突破分片推理隐私保护
  • 在加噪和稀疏化防御下仍能高保真还原输入,暴露系统脆弱性
  • 提出新度量与防御方案,适配隐私敏感场景的模型部署

将大语言模型部署在资源受限设备上仍具挑战,促使分片推理兴起——将模型分割至客户端与服务器端,仅传输中间激活以减轻计算负担并增强隐私。然而,分片推理在大模型场景下的隐私保护能力尚未充分研究。为此,本文提出ActInv,通过求解中间激活匹配问题,实现客户端输入的重建。大量实验表明,即使面对高斯噪声注入和激活稀疏化等常见防御手段,ActInv仍能实现高质量输入重构。为进一步系统理解该漏洞,我们提出扰动放大因子(PAF),量化各层对重构的内在抗性。分析发现,不同层的隐私泄漏程度不均,部分层极易泄露信息,而另一些层则具备天然防护能力。此外,我们证明通过校准扰动方向以最大化反向传播中的重构误差,可显著提升防御效果。基于此,设计出新的防御方案PriPert,并在隐私、实用性与计算开销方面进行综合评估,验证其有效性。

原文摘要 · Abstract (English)

The deployment of large language models (LLMs) on resource-constrained devices remains challenging, spurring interest in split inference, where models are partitioned between client and server to reduce computational burden and enhance privacy by transmitting only intermediate activations. However, the privacy-preserving capabilities of split inference, particularly in the context of LLMs, have not been exhaustively investigated. To fill this gap, we introduce ActInv, which solves an intermediate activation matching problem to reconstruct the client's input. Extensive evaluations demonstrate that ActInv achieves high-fidelity reconstructions, even in the presence of common perturbation-based defenses such as Gaussian noise injection and activation sparsification. To systematically understand this vulnerability, we develop Perturbation Amplification Factor (PAF), a metric for quantifying a layer's inherent resistance to reconstruction. Our analysis reveals that privacy vulnerability is not uniform across layers, with some layers being highly susceptible to leakage while others offer natural resistance. Furthermore, we demonstrate that defense effectiveness can be significantly improved by calibrating perturbation directions to maximize reconstruction error during backpropagation. Building on these insights, we design PriPert and conduct comprehensive evaluations, covering privacy, utility, and computational overhead, to demonstrate its effectiveness.

大模型安全隐私泄露分片推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。