arXiv:2605.30723cs.CL2026-05被引 2

不同大模型需匹配专属技能,MASA实现高效适配。

Skill is Not One-Size-Fits-All: Model-Aware Skill Alignment for LLM Agents

论文配图:Skill is Not One-Size-Fits-All: Model-Aware Skill Alignment for LLM Agents
图 1 · 摘自论文原文
  • 根据模型能力动态优化技能,不改权重
  • 跨4个模型3个环境测试,最高提升25.8分
  • 轻量重写器可泛化到新任务,成本极低

大型语言模型代理越来越多地在决策时调用外部预置技能(程序指令)以提升长程交互任务表现。现有技能库通常被视为与模型无关,相同技能格式被不同能力的模型通用。但我们在多个模型尺度上的控制实验表明,技能有效性强烈依赖于模型:一个模型受益的技能可能对另一模型有害。为此,我们提出MASA(Model-Aware Skill Alignment)框架,无需修改代理权重即可将技能适配至目标模型。MASA分两阶段运行:(1) 分层技能演化管道,通过爬山法和基于UCB的树搜索,结合环境反馈与模型能力画像,迭代重写通用与任务特定技能;(2) 基于演化轨迹训练的轻量级模型条件技能重写器,可在单次前向传播中复现适配效果。在三个交互环境与四个骨干模型上的实验显示,MASA始终取得最优整体性能,相较最强基线最高提升25.8分。所学重写器还可泛化至未见任务与环境,推理成本仅为教师大模型的极小部分,仍持续领先。

原文摘要 · Abstract (English)

LLM agents increasingly retrieve externally curated skills-procedural instructions retrieved at decision time-to improve performance on long-horizon interactive tasks. Existing skill libraries are typically treated as model-agnostic, reusing the same skill formulations across backbones with substantially different capacities and behaviors. However, our controlled experiments across multiple model scales show that skill effectiveness is strongly model-dependent: a skill that benefits one backbone can harm another. Motivated by this observation, we propose MASA Model-Aware Skill Alignment, a framework that adapts skills to each target backbone without modifying agent weights. MASA operates in two stages: (1) a hierarchical skill evolution pipeline that iteratively rewrites general and task-specific skills using hill climbing and UCB-driven tree search, guided by environment feedback and model capability profiles; and (2) a lightweight model-conditioned skill rewriter trained on evolution trajectories to reproduce the adaptation in a single forward pass. Experiments across three interactive environments and four backbones show that MASA consistently achieves the best overall performance, with gains of up to 25.8 points over the strongest baseline. The learned rewriter further generalizes to unseen tasks and environments without additional search, consistently outperforming a much larger teacher LLM at a fraction of the inference cost.

LLM代理技能对齐模型适配高效推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。