arXiv:2606.20333cs.AI2026-06被引 2

用少量虚拟令牌压缩自然语言技能,让冻结模型更高效地完成任务。

SoftSkill: Behavioral Compression for Contextual Adaptation

论文配图:SoftSkill: Behavioral Compression for Contextual Adaptation
图 1 · 摘自论文原文
  • 将技能转为可训练的连续上下文对象,仅用少数虚拟令牌替代长文本。
  • 在SearchQA等数据集上提升8.3至42.1分,优于传统方法且减少数千个令牌。
  • 适合希望轻量部署、高效适配的智能体系统开发者使用。

智能体技能通常以自然语言的Markdown文件形式部署,包含回答策略、证据使用习惯和任务流程。这些文件可读性强、便于迁移,但需通过冻结的语言模型间接解析:每个任务实例都需将长文本转化为生成时的行为。本文探讨是否可将自然语言技能直接初始化为紧凑的连续上下文对象,通过可训练的软增量(soft delta)在保持基础模型冻结的前提下进行优化。我们提出SoftSkill,一种基于冻结主干的方法,利用下一个词预测训练软技能,并在推理时作为潜在行为先验部署。在主要单轮设置中,长度为32的Qwen3.5-4B上的SoftSkill前缀在SearchQA上比无技能提示提升8.3分,在LiveMath上提升42.1分,在DocVQA上提升1.3分。相比SkillOpt,SoftSkill在SearchQA上提高5.2分,LiveMath上提高12.5分,同时将数百到数千个Markdown技能令牌替换为少数虚拟令牌。进一步研究代理执行这一更难场景发现,稀疏轨迹模仿虽提供有效信号,但尚不能稳健压缩长时程过程行为。结果表明,某些任务技能更适合被视为控制冻结模型进入任务的紧凑潜在指令,而非推理时需重解的附加文本。

原文摘要 · Abstract (English)

Agent skills are commonly deployed as natural-language Markdown files that encode answer policies, evidence-use habits, and task procedures. These files are readable and portable, but they are consumed indirectly: for each task instance, a frozen language model must translate a long textual artifact into generation-time behavior. This paper asks whether a natural-language skill can instead initialize a compact continuous context object, refined by a trainable soft delta while the base model remains frozen. We propose SoftSkill, a frozen-backbone method that tunes such soft skills with next-token prediction and deploys them as latent behavioral priors at inference time. In our main single-round setting, a length-32 SoftSkill prefix on Qwen3.5-4B improves over no-skill prompting by 8.3 points on SearchQA, 42.1 points on LiveMath, and 1.3 points on DocVQA. Relative to SkillOpt, SoftSkill improves accuracy by 5.2 points on SearchQA and 12.5 points on LiveMath, while replacing hundreds to thousands of Markdown skill tokens with a few virtual tokens. We further study agentic execution as a harder boundary case, where sparse trajectory imitation provides useful signal but does not yet robustly compress long-horizon procedural behavior. More broadly, the results suggest that some task skills are better treated not as additional Markdown to be reinterpreted at inference time, but as compact latent controls over how a frozen model enters the task.

智能体技能压缩冻结模型上下文学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。