arXiv:2605.25073cs.CRcs.AI2026-05

系统梳理大模型微调全周期安全威胁与防御,提出分阶段评估框架。

Security in the Fine-Tuning Lifecycle of Large Language Models: Threats, Defenses,Evaluation, and Future Directions

论文配图:Security in the Fine-Tuning Lifecycle of Large Language Models: Threats, Defenses,Evaluation, and Future Directions
图 1 · 摘自论文原文
  • 按干预时机将攻击防御分为微调前、中、后三阶段,构建统一分析框架。
  • 发现攻击效果随模型规模变化非单调,部分攻击在小型模型上失效。
  • 单阶段防御难以跨阶段通用,需考虑模型架构与对齐状态的协同影响。

微调是将预训练大语言模型(LLMs)适配到下游任务的核心环节,但其对训练数据、参数更新和可复用组件的依赖为攻击者提供了入口。威胁已从数据投毒、权重篡改演变为代理操纵和接口利用,现有综述缺乏覆盖完整微调生命周期的统一框架。本文系统梳理大模型微调安全,提出基于生命周期的分析框架,并设计统一实验评估体系。将攻击与防御机制按干预时间划分为预微调、微调中、微调后三个阶段,对比各阶段策略的演变与局限。在统一模型、硬件与协议环境下评估代表性方法,并开展跨阶段攻击-防御组合实验。结果显示:攻击有效性高度依赖模型类型,且与规模关系非单调——权重编辑攻击在早期模型有效,但在现代开源模型上失效;跨语言后门迁移在大规模模型中报告接近完美,却在测试的1B-4B模型上完全失败;仅使用纯良性样本即可破坏指令微调模型的安全对齐。单阶段防御普遍无法跨阶段泛化,防御效果由模型架构与对齐状态共同决定。研究识别出关键开放问题:配置鲁棒性防御、跨阶段防御组合、超越行为假设的嵌入空间攻击,并提出具体未来方向。

原文摘要 · Abstract (English)

Background: Fine-tuning is central to adapting pre-trained Large Language Models (LLMs) to downstream tasks, but its reliance on training data, parameter updates, and reusable components opens entry points for attackers. Threats have evolved from data poisoning and weight tampering to agent manipulation and interface exploitation, yet existing reviews lack a unified framework spanning the full fine-tuning lifecycle. Objective: This paper presents a systematic survey of LLM fine-tuning security and establishes a lifecycle-based framework for comparing attacks and defenses, complemented by unified empirical evaluation. Methods: We divide attack and defense mechanisms into three phases by intervention timing: pre-tuning, during-tuning, and post-tuning. Within each phase, strategies are reviewed and contrasted to expose their evolution and limitations. Representative methods are then evaluated under a unified model, hardware, and protocol setup, with cross-phase experiments pairing attacks and defenses from different phases. Results: Attack effectiveness is highly model-dependent and non-monotonic with scale: weight-editing attacks effective on earlier models lose impact on modern open-source LLMs; cross-lingual backdoor transfer, reported as near-perfect at larger scales, fails entirely on tested 1B-4B models; and purely benign samples can compromise safety alignment in instruction-tuned models. Single-phase defenses rarely generalize across phases, and defense effectiveness depends jointly on model architecture and alignment state. Conclusion: We identify key open problems (configuration-robust defense, cross-phase defense composition, and embedding-space attacks beyond behavioral assumptions) and propose concrete future research directions.

大模型安全微调防御攻击评估生命周期

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。