让大模型自己管任务流程,自动调用函数完成复杂任务
CELI: Controller-Embedded Language Model Interactions
- 把控制逻辑嵌入提示词,让模型自主管理任务流程
- 代码生成任务上比GPT-4提升4.9个百分点,文章生成94.4%达初稿质量
- 适合需要多步骤执行的自动化系统开发者
我们提出控制器嵌入语言模型交互(CELI)框架,将控制逻辑直接嵌入语言模型提示中,实现复杂多阶段任务的自主执行。该框架将控制权从传统编程环境转移至语言模型,使其能在保持与外部系统无缝交互的同时,自主管理计算流程。CELI支持任意函数调用及可变参数,弥合了语言模型的自适应推理能力与传统软件结构化控制机制之间的差距。我们在代码生成(HumanEval基准)和多阶段内容生成(维基风格文章)两个领域开展案例研究。结果显示,在HumanEval代码生成任务中,CELI相较最优基线GPT-4模型提升4.9个百分点;在多阶段内容生成中,94.4%的生成文章达到或超过初稿质量,其中44.4%为高质量。这些成果凸显了CELI在多样化计算场景中优化人工智能工作流的潜力。
原文摘要 · Abstract (English)
We introduce Controller-Embedded Language Model Interactions (CELI), a framework that integrates control logic directly within language model (LM) prompts, facilitating complex, multi-stage task execution. CELI addresses limitations of existing prompt engineering and workflow optimization techniques by embedding control logic directly within the operational context of language models, enabling dynamic adaptation to evolving task requirements. Our framework transfers control from the traditional programming execution environment to the LMs, allowing them to autonomously manage computational workflows while maintaining seamless interaction with external systems and functions. CELI supports arbitrary function calls with variable arguments, bridging the gap between LMs' adaptive reasoning capabilities and conventional software paradigms' structured control mechanisms. To evaluate CELI's versatility and effectiveness, we conducted case studies in two distinct domains: code generation (HumanEval benchmark) and multi-stage content generation (Wikipedia-style articles). The results demonstrate notable performance improvements across a range of domains. CELI achieved a 4.9 percentage point improvement over the best reported score of the baseline GPT-4 model on the HumanEval code generation benchmark. In multi-stage content generation, 94.4% of CELI-produced Wikipedia-style articles met or exceeded first draft quality when optimally configured, with 44.4% achieving high quality. These outcomes underscore CELI's potential for optimizing AI-driven workflows across diverse computational domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。