用知识图谱与提示树平衡大模型协作的不足与过度,降低成本提升效率。
Cochain: Balancing Insufficient and Excessive Collaboration in LLM Agent Workflows
- 构建跨阶段知识图谱与提示树,实现高效协作信息共享。
- 在多个数据集上优于基线模型,小模型+Cochain胜过GPT-4。
- 适合需要低成本高效率协作的业务流程自动化场景。
大型语言模型在执行复杂推理任务中表现出色。思维链有效提升推理能力,多智能体系统则通过整合多个智能体的集体智慧提供更全面的解决方案。然而,两者均存在显著局限:单智能体思维链因跨领域提示设计复杂而面临协作挑战;多智能体系统消耗大量令牌,且不可避免地稀释核心问题,尤其在业务工作流任务中尤为突出。为此,我们提出Cochain——一种协作提示框架,通过融合知识与提示,在较低成本下有效解决业务工作流协作问题。具体而言,我们构建了一个整合多阶段知识的知识图谱,并通过维护和检索提示树,获取业务流程其他阶段相关的提示信息。我们在多个数据集上对Cochain进行了广泛评估,结果表明其在提示工程与多智能体大模型方面均优于所有基线。此外,专家评估显示,小模型结合Cochain的表现超越GPT-4。
原文摘要 · Abstract (English)
Large Language Models (LLMs) have demonstrated impressive performance in executing complex reasoning tasks. Chain-of-thought effectively enhances reasoning capabilities by unlocking the potential of large models, while multi-agent systems provide more comprehensive solutions by integrating the collective intelligence of multiple agents. However, both approaches face significant limitations. Single-agent with chain-of-thought, due to the inherent complexity of designing cross-domain prompts, faces collaboration challenges. Meanwhile, multi-agent systems consume substantial tokens and inevitably dilute the primary problem, which is particularly problematic in business workflow tasks. To address these challenges, we propose Cochain, a collaboration prompting framework that effectively solves the business workflow collaboration problem by combining knowledge and prompts at a reduced cost. Specifically, we construct an integrated knowledge graph that incorporates knowledge from multiple stages. Furthermore, by maintaining and retrieving a prompts tree, we can obtain prompt information relevant to other stages of the business workflow. We perform extensive evaluations of Cochain across multiple datasets, demonstrating that Cochain outperforms all baselines in both prompt engineering and multi-agent LLMs. Additionally, expert evaluation results indicate that the use of a small model in combination with Cochain outperforms GPT-4.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。