用ASP增强大模型对话可靠性,实现双代理安全协作。
Reliable Collaborative Conversational Agent System Based on LLMs and Answer Set Programming
- 采用知识库驱动的双代理架构,通过ASP保证推理一致性。
- 在快餐店叫餐场景中,系统正确率显著高于真实AI点餐系统。
- 信息隐藏在知识库中传递,防止恶意注入,适合高可靠性场景。
随着大语言模型驱动的AI机器人普及,其在任务导向对话中的潜力备受关注。然而,完全依赖大模型的机器人在知识可信度上存在缺陷,任务最终结果难以保证。多代理协作也面临挑战:信息传递不明确,依赖提示词,易受恶意知识干扰。借助答案集编程(ASP)等知识表示与推理工具,可构建更安全可靠的对话代理,并提升代理间通信的可靠性。本文提出经理-客户-服务双代理范式,各代理共享同一知识库,独立完成分配任务,通过知识库交互确保一致性。信息封装且对用户不可见,保障传输安全。为验证该范式,我们构建了AutoManager系统,用于模拟美国Taco Bell快餐店的Drive-Thru服务。其中客服代理负责接收订单,经理代理管理菜单与食材库存。评估结果显示,该系统在可靠性方面优于真实的Taco Bell Drive-Thru AI点餐系统。
原文摘要 · Abstract (English)
As the Large-Language-Model-driven (LLM-driven) Artificial Intelligence (AI) bots became popular, people realized their strong potential in Task-Oriented Dialogue (TOD). However, bots relying wholly on LLMs are unreliable in their knowledge, and whether they can finally produce a correct outcome for the task is not guaranteed. The collaboration among these agents also remains a challenge, since the necessary information to convey is unclear, and the information transfer is by prompts: unreliable, and malicious knowledge is easy to inject. With the help of knowledge representation and reasoning tools such as Answer Set Programming (ASP), conversational agents can be built safely and reliably, and communication among the agents made more reliable as well. We propose a Manager-Customer-Service Dual-Agent paradigm, where ASP-driven bots share the same knowledge base and complete their assigned tasks independently. The agents communicate with each other through the knowledge base, ensuring consistency. The knowledge and information conveyed are encapsulated and invisible to the users, ensuring the security of information transmission. To illustrate the dual-agent conversational paradigm, we have constructed AutoManager, a collaboration system for managing the drive-through window of a fast-food restaurant such as Taco Bell in the US. In AutoManager, the customer service bot takes the customer's order while the manager bot manages the menu and food supply. We evaluated our AutoManager system and compared it with the real-world Taco Bell Drive-Thru AI Order Taker, and the results show that our method is more reliable.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。