将企业知识库转化为可导航的技能目录,提升问答与检索生成效果。
Corpus2Skill: Distilling Enterprise Knowledge into Navigable Agent Skills for QA and RAG

- 离线编译知识库生成分层技能目录,服务时用LLM agent逐层导航检索。
- 在企业客服数据集上,答案质量和事实准确率均优于多种基线方法。
- 适合有明确分类结构的单领域知识库,不适用于开放域或表格型数据。
检索增强生成(RAG)虽能将大模型输出锚定于外部证据,但将其视为被动消费搜索结果的实体,忽视了语料库的组织结构及未见内容。我们提出Corpus2Skill:一种针对有限、结构清晰语料库(如企业知识库)的系统级检索架构。离线阶段,系统将语料库编译为分层技能目录;推理时,大模型代理通过逐层摘要导航至文档,并在无效分支回溯。在企业客户支持基准测试中,Corpus2Skill在适度成本代价下,显著提升答案质量与事实依据性,优于单次密集检索、混合检索、层次检索及代理式RAG基线,且该优势在编码器匹配控制和配对显著性检验下依然成立。十一数据集研究显示,语料导航并非万能方案:在五数据集上显著胜出,三组持平,三组落后。其优势体现在具有可恢复主题分类的单领域语料库,而对开放域事实池或同质表格语料,传统扁平检索更优。我们据此提出知识增强系统的设计准则。代码已开源:https://github.com/dukesun99/Corpus2Skill。
原文摘要 · Abstract (English)
Retrieval-Augmented Generation (RAG) grounds LLM responses in external evidence but treats the model as a passive consumer of search results, with no view of how the corpus is organized or what it has not yet seen. We present Corpus2Skill, a system-level retrieval architecture for bounded, structurally coherent corpora such as enterprise knowledge bases: an offline compiler distills the corpus into a hierarchical skill directory, and at serve time an LLM agent navigates it, drilling from a bird's-eye view through progressively finer summaries down to documents and backtracking when a branch is unproductive. On an enterprise customer-support benchmark, Corpus2Skill improves both answer quality and grounding over single-shot dense, hybrid, hierarchical-retrieval, and agentic RAG baselines at a moderate cost tradeoff, and the lead persists under encoder-matched controls and paired significance tests. An eleven-dataset study shows that corpus navigation is not a universal replacement for retrieval: it significantly wins on five datasets, ties on three, and loses on three. It helps on single-domain corpora with a recoverable topical taxonomy, but flat retrieval remains preferable on open-domain factoid pools or homogeneous-tabular corpora that defeat top-level clustering. We characterize this scope distinction as a design guideline for knowledge-grounded systems. Code is available at https://github.com/dukesun99/Corpus2Skill.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。