如何让大模型代理在真实场景中稳定运行
Practical Considerations for Agentic LLM Systems
- 按规划、记忆、工具、控制流四类归纳实用设计思路
- 强调处理随机性与资源效率的关键挑战
- 适合关注大模型应用落地的开发者和研究者
随着大语言模型能力的提升,将其作为自主代理的基础模型的兴趣日益增长。尽管LLM在自然语言领域展现出涌现能力与广泛专长,但其内在不可预测性使得实现LLM代理充满挑战,导致研究与实际应用之间存在差距。本文基于应用导向文献中的常见实践,将相关研究成果归入四大类别:规划、记忆、工具与控制流,并提出构建可靠LLM代理时需考虑的实际问题,如应对随机性、高效管理资源等。虽未进行实证评估,但为学术界与产业界讨论代理式LLM设计的关键方面提供了必要背景。
原文摘要 · Abstract (English)
As the strength of Large Language Models (LLMs) has grown over recent years, so too has interest in their use as the underlying models for autonomous agents. Although LLMs demonstrate emergent abilities and broad expertise across natural language domains, their inherent unpredictability makes the implementation of LLM agents challenging, resulting in a gap between related research and the real-world implementation of such systems. To bridge this gap, this paper frames actionable insights and considerations from the research community in the context of established application paradigms to enable the construction and facilitate the informed deployment of robust LLM agents. Namely, we position relevant research findings into four broad categories--Planning, Memory, Tools, and Control Flow--based on common practices in application-focused literature and highlight practical considerations to make when designing agentic LLMs for real-world applications, such as handling stochasticity and managing resources efficiently. While we do not conduct empirical evaluations, we do provide the necessary background for discussing critical aspects of agentic LLM designs, both in academia and industry.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。