arXiv:2510.15416cs.AI2025-10被引 2

让LoRA适配器像工具一样被语言模型动态调用,实现智能组合。

Adaptive Minds: Empowering Agents with LoRA-as-Tools

  • 将LoRA适配器作为可调用工具,由基础模型按需选择
  • 30个适配器路由准确率达98.3%,多任务提升最高达84.0个百分点
  • 适合构建可灵活组合专家的通用智能代理系统

我们研究了一种框架,其中LoRA适配器被视为可调用工具,由基础语言模型动态选择并调用。假设当适配器经过训练具备强领域特异性表现,并带有清晰元数据时,基础模型能可靠地将查询路由至相应专家,从而在单一框架内聚合多个专用适配器的优势。我们提出Adaptive Minds框架,研究单步路由与多步代理推理。在此设置中,代理可迭代调用多个适配器及其他工具(如外部API、检索系统或执行环境),并在多步中推理其输出。这将适配器重新定义为可在推理过程中组合的模块化技能或记忆单元,而非静态应用。评估显示,路由层在30个适配器库上达到98.3%准确率;经良好训练的专家在九个任务族中带来+4.6至+84.0百分点的严格评分提升,且在每个显现出领域信号的基准上,AM路由器的表现仅比直接使用专家低5个百分点以内。结果表明,该方法的有效性取决于适配器的质量与专业化程度,而允许多个专家灵活组合,可显著拓展语言模型代理的实际能力,迈向更通用的工具增强型智能。

原文摘要 · Abstract (English)

We investigate a framework in which LoRA adapters are treated as callable tools that a base language model can dynamically select and invoke. We hypothesize that, when adapters are trained to provide strong domain-specific gains and are exposed with clear metadata, a base model can reliably route queries to the appropriate expert, effectively aggregating the benefits of many specialized adapters within a single framework. We introduce Adaptive Minds, a general framework within which we study both single-step routing and multi-step agentic reasoning. In this setting, the agent can iteratively invoke multiple adapters alongside other tools (e.g., external APIs, retrieval systems, or execution environments) and reason over their outputs across multiple steps. This reframes adapters as modular skills or memory units that can be composed during reasoning rather than statically applied. In our evaluation, the routing layer reaches 98.3% accuracy on a 30-adapter library, and well-trained specialists provide +4.6 to +84.0 percentage points of strict-scorer gain across nine task families under a single shared training recipe; the AM router aggregates these gains within 5 pp of the direct specialist on every benchmark whose queries surface domain signal. Our findings suggest that the effectiveness of this approach depends on the quality and specialization of individual adapters, and that enabling flexible composition of many such experts can significantly expand the practical capabilities of language model agents, moving toward more general, tool-augmented intelligence.

LoRA智能代理工具调用专家系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。