arXiv:2609.09054cs.LGcs.AI2026-09

无需微调即可生成大模型行为控制向量,实现高效精准的模型修改。

Training-Free Task Vectors for LLM Behavioral Control

论文配图:Training-Free Task Vectors for LLM Behavioral Control
图 1 · 摘自论文原文
  • 基于前向传播统计量映射激活控制向量,直接生成权重空间编辑方向。
  • 可实现行为增强、抑制与组合,且保持通用知识与解题能力不变。
  • 适用于需要快速调整模型行为的场景,如安全对齐与功能定制。

任务向量通过微调模型与预训练初始化之间的差异,识别权重空间中有语义意义的方向,实现训练后模型编辑。然而,依赖微调导致计算成本高,限制了实际应用。为此,本文提出无训练任务向量(TFTVs),可在不进行微调的情况下计算类似任务向量的方向。该方法仅使用前向传播统计量,将激活控制向量映射为秩一权重空间编辑,同时满足加法学习、减法遗忘和多编辑组合的算术性质。实验表明,TFTVs在大语言模型行为控制任务中能持续放大、抑制和组合目标行为,同时保留通用知识与问题求解能力。与现有编辑和引导基线相比,TFTVs在行为控制强度上更优,且保持或接近最佳的性能保留水平。代码已公开于 tftv-llm.github.io。

原文摘要 · Abstract (English)

Task vectors enable post-training model editing by identifying semantically meaningful directions in weight space, typically computed as the difference between a fine-tuned model and its pretrained initialization. However, this reliance on fine-tuning makes discovering such directions costly and limits the practicality of post-training model editing. To address this limitation, we introduce Training-Free Task Vectors (TFTVs), a novel method to compute task-vector-like directions without requiring fine-tuning. Our method maps activation steering vectors to rank-one weight-space edits using only forward-pass statistics, while satisfying arithmetic properties that directly support learning via addition, forgetting via subtraction, and the composition of multiple edits. Empirically, we evaluate TFTVs on large language model behavioral control tasks and show that they consistently amplify, suppress, and compose target behaviors while preserving general knowledge and problem-solving skills. We also validate our method against other editing and steering baselines, experimentally demonstrating that TFTVs achieve stronger trait control with better or competitive utility preservation. We hope our work opens new directions for the community in post-training model editing and broader training-free model control. Code is available on the project website: tftv-llm.github.io.

模型编辑无训练行为控制大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。