KIMAs系统整合多源知识,提升对话问答的准确与流畅性。
KIMAs: A Configurable Knowledge Integrated Multi-Agent System
- 通过上下文管理与查询重写,提升检索精度与多轮对话连贯性
- 支持高效知识路由与并行化多智能体流水线,实现低延迟响应
- 可灵活配置,适合不同规模的知识应用开发
基于大语言模型的知识密集型对话已成为热门且实用的应用,广泛用于各类辅助任务。当前多数应用依赖检索增强生成(RAG)技术,尽管开源RAG框架降低了开发门槛,但在面对主题与格式异构的数据、对话上下文管理以及低延迟响应需求时仍显不足。本文提出可配置的知识集成多智能体系统KIMAs,以应对这些挑战。KIMAs具备四项核心能力:1)上下文管理与查询重写机制,提升检索准确率与多轮对话一致性;2)高效的知识路由与检索;3)简单有效的过滤与引用生成机制;4)优化的可并行化多智能体流水线执行。我们展示了如何将KIMAs配置为三个实际运行的应用,验证其在不同规模与侧重下的可靠性能,为大模型在真实场景中的部署提供可扩展框架。
原文摘要 · Abstract (English)
Knowledge-intensive conversations supported by large language models (LLMs) have become one of the most popular and helpful applications that can assist people in different aspects. Many current knowledge-intensive applications are centered on retrieval-augmented generation (RAG) techniques. While many open-source RAG frameworks facilitate the development of RAG-based applications, they often fall short in handling practical scenarios complicated by heterogeneous data in topics and formats, conversational context management, and the requirement of low-latency response times. This technical report presents a configurable knowledge integrated multi-agent system, KIMAs, to address these challenges. KIMAs features a flexible and configurable system for integrating diverse knowledge sources with 1) context management and query rewrite mechanisms to improve retrieval accuracy and multi-turn conversational coherency, 2) efficient knowledge routing and retrieval, 3) simple but effective filter and reference generation mechanisms, and 4) optimized parallelizable multi-agent pipeline execution. Our work provides a scalable framework for advancing the deployment of LLMs in real-world settings. To show how KIMAs can help developers build knowledge-intensive applications with different scales and emphases, we demonstrate how we configure the system to three applications already running in practice with reliable performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。