arXiv:2509.23594cs.CRcs.CV2025-09ICCV

用合成数据偷取LoRA模型,1万次查询就成功96.6%

StolenLoRA: Exploring LoRA Extraction Attacks via Synthetic Data

  • 用大模型生成提示词构造合成数据,训练替代模型
  • 仅1万次查询即达96.6%攻击成功率,跨骨干网络也有效
  • 揭示LoRA易被提取的漏洞,适合安全研究者关注

参数高效微调(PEFT)方法如LoRA已广泛用于视觉模型定制化部署,但其紧凑结构带来新安全隐患,尤其易受模型提取攻击。本文提出一种新型攻击——LoRA提取,旨在从公开预训练模型中还原出LoRA适配模型。为此,我们提出StolenLoRA方法,通过大语言模型生成有效提示词构建合成数据,并采用基于分歧的半监督学习(DSL)策略,在有限查询下最大化信息获取。实验表明,该方法在仅1万次查询下攻击成功率高达96.60%,即使在攻击者与受害者使用不同预训练骨干网络的跨骨干场景中仍有效。结果揭示了LoRA适配模型的特定脆弱性,凸显针对PEFT方法设计鲁棒防御机制的紧迫性。我们还初步探索了基于多样化LoRA部署的防御策略,验证其在缓解此类攻击中的潜力。

原文摘要 · Abstract (English)

Parameter-Efficient Fine-Tuning (PEFT) methods like LoRA have transformed vision model adaptation, enabling the rapid deployment of customized models. However, the compactness of LoRA adaptations introduces new safety concerns, particularly their vulnerability to model extraction attacks. This paper introduces a new focus of model extraction attacks named LoRA extraction that extracts LoRA-adaptive models based on a public pre-trained model. We then propose a novel extraction method called StolenLoRA which trains a substitute model to extract the functionality of a LoRA-adapted model using synthetic data. StolenLoRA leverages a Large Language Model to craft effective prompts for data generation, and it incorporates a Disagreement-based Semi-supervised Learning (DSL) strategy to maximize information gain from limited queries. Our experiments demonstrate the effectiveness of StolenLoRA, achieving up to a 96.60% attack success rate with only 10k queries, even in cross-backbone scenarios where the attacker and victim models utilize different pre-trained backbones. These findings reveal the specific vulnerability of LoRA-adapted models to this type of extraction and underscore the urgent need for robust defense mechanisms tailored to PEFT methods. We also explore a preliminary defense strategy based on diversified LoRA deployments, highlighting its potential to mitigate such attacks.

LoRA模型提取安全合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。