arXiv:2510.10486cs.CRcs.AI2025-10

提出首个针对开源大模型的恶意嵌入攻击,可隐蔽执行恶意代码。

MEASER: Malware embedding attacks on open-source LLMs

  • 通过识别关键参数并嵌入载荷,分步实现恶意攻击。
  • 在所有测试中实现0误码率,且对量化和微调有强鲁棒性。
  • 适合关注模型安全与对抗攻击的研究者阅读。

开源大语言模型(LLMs)在神经处理任务中表现出色,得益于其开放共享特性。然而,完全公开源代码、模型参数和训练数据虽促进透明,也使其面临恶意嵌入攻击(MEAs)风险,且危害尚未被充分理解。本文系统化形式化了针对开源LLMs的各类威胁模型,重点关注具备内部知识的攻击者在模型共享阶段注入载荷与触发器的情形。为此,我们提出首个针对开源LLMs的恶意嵌入攻击——MEASER,该方法通过识别目标参数、嵌入载荷、注入触发器并依次执行载荷实现攻击。为增强抗量化和参数高效微调(PEFT)能力,MEASER引入幅度自适应相对量化索引调制(MAR-QIM),结合LDPC码与扩频调制。为保障隐蔽性,设计性能感知重要性度量,仅选择对模型性能影响最小的参数进行攻击。在四个主流开源LLMs上的大量实验表明,MEASER的隐蔽率显著优于现有针对通用DNN的攻击,在所有设置下均保持0比特误码率(BER)。此外,其在量化模型上仍保持优异隐蔽性。我们呼吁开展针对MEASER的防御研究。

原文摘要 · Abstract (English)

Open-source large language models (LLMs) have demonstrated considerable dominance over proprietary LLMs in resolving neural processing tasks, thanks to the collaborative and sharing nature. Although full access to source codes, model parameters, and training data lays the groundwork for transparency, we argue that such a full-access manner is vulnerable to MEAs, and their ill-effects are not fully understood. In this paper, we conduct a systematic formalization for MEAs on open-source LLMs by enumerating all possible threat models associated with adversary objectives, knowledge, and capabilities. Therein, the threat posed by adversaries with internal knowledge, who inject payloads and triggers during the model sharing phase, is of practical interest. We go even further and propose the first MEA against open-source LLMs, dubbed MEASER, which wields impacts through identifying targeted parameters, embedding payloads, injecting triggers, and executing payloads sequentially. Particularly, MEASER enhances the attack robustness against quantization and parameter-efficient fine-tuning (PEFT) by employing the Magnitude-Adaptive Relative Quantization Index Modulation (MAR-QIM) mechanism, synergized with LDPC codes and spread spectrum modulation. In addition, to achieve stealthiness, MEASER devises the performance-aware importance metric to identify targeted parameters with the least degradation of model performance. Extensive experiments on four popular open-source LLMs show that the stealth rate of MEASER outperforms existing MEAs (for general DNNs) significantly, while consistently achieving a 0 bit error rate (BER) in all settings. Moreover, MEASER also maintains superior stealthiness on quantized models. We appeal for investigations on countermeasures against MEASER in view of the significant attack effectiveness.

模型安全恶意攻击大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。