arXiv:2606.14210cs.CRcs.AI2026-06中稿 · ICML

提出双向数据泄露攻击与防御,保护大模型分拆部署中的输入输出隐私。

From Prompts to Responses: Dual-Sided Data Leakage and Defense in Split Large Language Models

论文配图:From Prompts to Responses: Dual-Sided Data Leakage and Defense in Split Large Language Models
图 1 · 摘自论文原文
  • 双侧初始化+分块逆向,同时破解输入提示和生成回复
  • 新攻击在长序列上性能超越现有方法30%以上
  • 适配器+互信息正则化,防御效果强且不影响任务表现

大型语言模型(LLMs)在隐私敏感领域应用日益广泛,用户需在外部API暴露风险与本地部署高成本间权衡。分拆学习因此成为资源受限环境下微调与推理的可行方案,但引入了新的隐私风险。以往研究主要关注私有输入提示通过中间表示的逆向攻击,而对生成回复中潜在敏感信息泄露问题未予充分探索。本文揭示分拆大模型的新漏洞,提出双侧初始化分块逆向攻击(PIDI),该两阶段攻击同时针对输入提示与输出响应,在长序列场景下显著优于现有方法。为应对双侧威胁,进一步提出基于适配器的双侧防护机制ADMI,结合适配器本地预热策略与互信息正则化,在几乎不损害任务性能的前提下实现强隐私保护。跨多种任务与模型的大量实验表明,ADMI能有效抵御PIDI及其他前沿逆向攻击。代码已开源:https://github.com/FLAIR-THU/VFLAIR-LLM。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly deployed in privacy-sensitive domains, where users must balance the risk of data exposure through external APIs against the high computational cost of local deployment. Split learning has therefore emerged as a promising paradigm for LLM fine-tuning and inference under limited local resources. However, it introduces new privacy risks. Prior work primarily studies leakage of private input prompts, typically via inversion attacks on intermediate representations, while the potential for sensitive information leakage through generative response outputs remains largely unexplored. In this work, we unveil novel vulnerabilities of Split-LLM by presenting Patched Model Inversion with Dual-Sided Initialization (PIDI), a two-stage attack that simultaneously targets both private input prompts and output responses in Split-LLM settings. It combines dual-sided initialization with a patched inversion strategy to tackle long sequences, substantially outperforming prior inversion methods. To counter threats from both sides, we further propose the Adapter-based DualGuard with Mutual Information Defense (ADMI), which integrates an adapter-based local warmup strategy and mutual information regularization to provide a strong empirical privacy protection with minimal impact on task performance. Extensive experiments across diverse tasks and models demonstrate that ADMI effectively defends against PIDI and other state-of-the-art inversion attacks. Our code is publicly available at https://github.com/FLAIR-THU/VFLAIR-LLM.

隐私保护分拆学习逆向攻击大模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。