用大模型生成元数据,提升企业知识库检索精度与效率
A Systematic Framework for Enterprise Knowledge Retrieval: Leveraging LLM-Generated Metadata to Enhance RAG Systems
- 用大模型动态生成文档片段元数据,增强语义表示
- 递归分块+TF-IDF加权嵌入达82.5%精确率,排名质量NDCG 0.813
- 实测延迟低于30毫秒,适合高并发企业级RAG系统部署
在企业环境中,从庞大复杂的知识库中高效检索相关信息对运营效率和决策至关重要。本文提出一种基于大语言模型(LLM)的元数据增强系统性框架,用于提升检索增强生成(RAG)系统的文档检索效果。研究采用结构化流程,动态生成文档片段的有意义元数据,显著改善其语义表征与检索准确率。通过控制的3×3实验矩阵,比较三种分块策略(语义、递归、朴素)与三种嵌入方法(仅内容、TF-IDF加权、前缀融合),并通过消融分析分离各组件贡献。结果表明,元数据增强方法持续优于仅内容基线,递归分块搭配TF-IDF加权嵌入达到82.5%精确率,朴素分块结合前缀融合实现最强排序质量(NDCG 0.813)。评估采用交叉编码器重排序生成近似标准真值,经贝叶斯校正配对t检验确认统计显著性。研究证实元数据增强可优化向量空间组织与检索效能,同时保持子30毫秒P95延迟,为企事业单位部署高性能、可扩展RAG系统提供量化决策依据。
原文摘要 · Abstract (English)
In enterprise settings, efficiently retrieving relevant information from large and complex knowledge bases is essential for operational productivity and informed decision-making. This research presents a systematic empirical framework for metadata enrichment using large language models (LLMs) to enhance document retrieval in Retrieval-Augmented Generation (RAG) systems. Our approach employs a structured pipeline that dynamically generates meaningful metadata for document segments, substantially improving their semantic representations and retrieval accuracy. Through a controlled 3 X 3 experimental matrix, we compare three chunking strategies -- semantic, recursive, and naive -- and evaluate their interactions with three embedding techniques -- content-only, TF-IDF weighted, and prefix-fusion -- isolating the contribution of each component through ablation analysis. The results demonstrate that metadata-enriched approaches consistently outperform content-only baselines, with recursive chunking paired with TF-IDF weighted embeddings yielding 82.5% precision and naive chunking with prefix-fusion achieving the strongest ranking quality (NDCG 0.813). Our evaluation employs cross-encoder reranking for silver-standard ground truth generation, with statistical significance confirmed via Bonferroni-corrected paired t-tests. These findings confirm that metadata enrichment improves vector space organization and retrieval effectiveness while maintaining sub-30 ms P95 latency, providing a quantitative decision framework for deploying high-performance, scalable RAG systems in enterprise settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。