arXiv:2602.09987cs.LGcs.AI2026-02被引 4

通过微调训练数据,用少量修改实现模型行为精准控制。

Infusion: Shaping Model Behavior by Editing Training Data via Influence Functions

  • 基于影响函数近似,计算训练数据的微小扰动以改变模型行为。
  • 仅修改0.2%训练数据(100/45,000)即在CIFAR-10上达到基准效果。
  • 方法可跨模型架构迁移,适合研究数据安全与对抗防御者。

影响函数通常用于将模型行为归因于训练文档。我们探索其反向应用:设计能诱导模型行为变化的训练数据。我们的框架Infusion利用可扩展的影响函数近似,计算对训练文档的小幅扰动,从而通过参数变化引发目标行为改变。我们在视觉与语言领域评估了该方法在数据投毒任务中的表现。在CIFAR-10上,仅对0.2%(100/45,000)的训练文档进行细微编辑,即可与插入少量显式行为样本的基线方法相媲美。我们还发现,Infusion在不同架构间(ResNet ↔ CNN)具有迁移性,表明单一污染语料库可影响多个独立训练的模型。初步语言实验表明,该方法在模型已掌握的行为基础上最有效,而对新行为提升有限。结果表明,对训练数据的微小、隐蔽修改可系统性塑造模型行为,凸显训练数据可解释性对攻击者与防御者的重要性。代码已开源:https://github.com/jrosseruk/infusion。

原文摘要 · Abstract (English)

Influence functions are commonly used to attribute model behavior to training documents. We explore the reverse: crafting training data that induces model behavior. Our framework, Infusion, uses scalable influence-function approximations to compute small perturbations to training documents that induce targeted changes in model behavior through parameter shifts. We evaluate Infusion on data poisoning tasks across vision and language domains. On CIFAR-10, we show that making subtle edits via Infusion to just 0.2% (100/45,000) of the training documents can be competitive with the baseline of inserting a small number of explicit behavior examples. We also find that Infusion transfers across architectures (ResNet $\leftrightarrow$ CNN), suggesting a single poisoned corpus can affect multiple independently trained models. In preliminary language experiments, we characterize when our approach increases the probability of target behaviors and when it fails, finding it most effective at amplifying behaviors the model has already learned. Taken together, these results show that small, subtle edits to training data can systematically shape model behavior, underscoring the importance of training data interpretability for adversaries and defenders alike. We provide the code here: https://github.com/jrosseruk/infusion.

数据投毒影响函数模型控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。