arXiv:2411.01747cs.CL2024-11被引 33

让大模型自主生成动作,突破预设动作限制。

DynaSaur: Large Language Agents Beyond Predefined Actions

  • 大模型用通用编程语言生成并执行动态动作
  • 实验显示性能显著优于固定动作集方法
  • 适合需要灵活应对未知场景的智能系统

现有大语言模型代理系统通常在每一步从固定预设的动作集中选择动作。该方法在封闭、特定范围内有效,但在真实开放环境中面临两大挑战:(1)严重限制了代理的规划与行动能力;(2)需大量人工枚举和实现所有可能动作,难以应对动作数量庞大的复杂环境。为此,我们提出一种可动态创建和组合动作的大模型代理框架。该框架中,代理通过生成并执行通用编程语言编写的程序与环境交互,且生成的动作会随时间积累以供未来复用。在多个基准上的广泛实验表明,该框架显著提升了灵活性,优于依赖固定动作集的先前方法。尤其在预设动作不足或失效的意外情况下,能实现自适应与恢复。代码见 https://github.com/adobe-research/dynasaur。

原文摘要 · Abstract (English)

Existing LLM agent systems typically select actions from a fixed and predefined set at every step. While this approach is effective in closed, narrowly scoped environments, it presents two major challenges for real-world, open-ended scenarios: (1) it significantly restricts the planning and acting capabilities of LLM agents, and (2) it requires substantial human effort to enumerate and implement all possible actions, which is impractical in complex environments with a vast number of potential actions. To address these limitations, we propose an LLM agent framework that can dynamically create and compose actions as needed. In this framework, the agent interacts with its environment by generating and executing programs written in a general-purpose programming language. Moreover, generated actions are accumulated over time for future reuse. Our extensive experiments across multiple benchmarks show that this framework significantly improves flexibility and outperforms prior methods that rely on a fixed action set. Notably, it enables LLM agents to adapt and recover in scenarios where predefined actions are insufficient or fail due to unforeseen edge cases. Our code can be found in https://github.com/adobe-research/dynasaur.

大模型代理动态动作程序生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。