arXiv:2604.04247cs.AIcs.CL2026-04被引 8

让语言模型代理并行学习任务提示,速度提升17倍且不降精度。

Combee: Scaling Prompt Learning for Self-Improving Language Model Agents

  • 通过并行扫描与增强洗牌机制,支持多代理同时学习
  • 动态批量控制器平衡学习质量与延迟,避免并行时性能下降
  • 适合需要大规模并行推理的自进化智能体系统

近期提示学习进展使大语言模型代理能在不修改参数的情况下,从推理时上下文获取任务相关知识。例如,现有方法(如ACE或GEPA)可通过前序代理运行结果优化系统提示以提高准确率。然而,这些方法主要聚焦于单代理或低并行场景,难以高效利用大量收集的智能体轨迹。随着从多智能体轨迹中学习的趋势增长,并行化提示学习具有显著效率优势。但缺乏合理扩展策略导致高并行下性能下降。为此,我们提出Combee框架,实现可扩展的并行提示学习。Combee通过并行扫描和增强洗牌机制加速学习,引入动态批量控制器平衡质量和延迟。在AppWorld、Terminal-Bench、Formula和FiNER上的评估显示,Combee相比以往方法最高提速17倍,准确率相当或更优,成本相当。

原文摘要 · Abstract (English)

Recent advances in prompt learning allow large language model agents to acquire task-relevant knowledge from inference-time context without parameter changes. For example, existing methods (like ACE or GEPA) can learn system prompts to improve accuracy based on previous agent runs. However, these methods primarily focus on single-agent or low-parallelism settings. This fundamentally limits their ability to efficiently learn from a large set of collected agentic traces. It would be efficient and beneficial to run prompt learning in parallel to accommodate the growing trend of learning from many agentic traces or parallel agent executions. Yet without a principled strategy for scaling, current methods suffer from quality degradation with high parallelism. To improve both the efficiency and quality of prompt learning, we propose Combee, a novel framework to scale parallel prompt learning for self-improving agents. Combee speeds up learning and enables running many agents in parallel while learning from their aggregate traces without quality degradation. To achieve this, Combee leverages parallel scans and employs an augmented shuffle mechanism; Combee also introduces a dynamic batch size controller to balance quality and delay. Evaluations on AppWorld, Terminal-Bench, Formula, and FiNER demonstrate that Combee achieves up to 17x speedup over previous methods with comparable or better accuracy and equivalent cost.

提示学习智能体并行计算自进化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。