攻击者可借数据投毒,让小模型生成大量偏见内容。
Cascading Adversarial Bias from Injection to Distillation in Language Models
- 用25条毒数据污染教师模型,偏见随蒸馏放大。
- 目标攻击下学生模型76.9%响应含偏见,高于教师的69.4%。
- 现有检测与防御手段均失效,需专门防护机制。
模型蒸馏已成为创建小型可部署语言模型的关键技术,保留大模型能力。然而广泛部署带来对抗性操纵风险。本文研究蒸馏模型在训练中受偏见注入的脆弱性。实验表明,攻击者仅需少量数据投毒即可在教师模型中注入细微偏见,并通过蒸馏传播至学生模型,且显著放大。提出两种传播模式:无目标传播(影响多个任务)和目标传播(聚焦特定任务)。仅25个毒样本(0.25%投毒率)下,目标场景中学生模型76.9%输出含偏见,高于教师模型的69.4%;无目标传播时,学生模型在未见任务上偏见出现频率提升6倍至29倍。评估涵盖六类偏见(定向广告、钓鱼链接、叙事操控、不安全编码)、多种蒸馏方法及文本与代码生成模态。现有防御手段——困惑度过滤、偏见检测系统、基于LLM的自动评分框架——均无法有效应对。结果揭示蒸馏模型存在严重安全漏洞,亟需针对性防护策略。论文提出实用设计原则以构建高效对抗偏见的缓解机制。
原文摘要 · Abstract (English)
Model distillation has become essential for creating smaller, deployable language models that retain larger system capabilities. However, widespread deployment raises concerns about resilience to adversarial manipulation. This paper investigates vulnerability of distilled models to adversarial injection of biased content during training. We demonstrate that adversaries can inject subtle biases into teacher models through minimal data poisoning, which propagates to student models and becomes significantly amplified. We propose two propagation modes: Untargeted Propagation, where bias affects multiple tasks, and Targeted Propagation, focusing on specific tasks while maintaining normal behavior elsewhere. With only 25 poisoned samples (0.25% poisoning rate), student models generate biased responses 76.9% of the time in targeted scenarios - higher than 69.4% in teacher models. For untargeted propagation, adversarial bias appears 6x-29x more frequently in student models on unseen tasks. We validate findings across six bias types (targeted advertisements, phishing links, narrative manipulations, insecure coding practices), various distillation methods, and different modalities spanning text and code generation. Our evaluation reveals shortcomings in current defenses - perplexity filtering, bias detection systems, and LLM-based autorater frameworks - against these attacks. Results expose significant security vulnerabilities in distilled models, highlighting need for specialized safeguards. We propose practical design principles for building effective adversarial bias mitigation strategies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。