arXiv:2502.19596cs.AIcs.IR2025-02中稿 · CIKM 2025 Applied …被引 2

企业内部文档问答系统,实现精准溯源与隐私保护。

Reference-Aligned Retrieval-Augmented Question Answering over Heterogeneous Proprietary Documents

  • 将多模态企业文档转为结构化问答对,支持私有化部署
  • 相比基线,事实正确性、信息量和帮助度分别提升1.79~1.94分
  • 适合需要安全合规的企业知识管理场景

企业专有文档包含丰富领域知识,但体量庞大且结构混乱,员工获取信息效率低。例如汽车行业的碰撞测试每项成本数十万美元,产生大量详细文档,决策时检索仍耗时费力。基于检索增强生成(RAG)的问答系统虽具潜力,但构建内部RAG-QA系统面临三大挑战:处理异构多模态数据、保障数据隐私、实现答案片段与原始来源的可追溯关联。为此,我们提出一个面向企业内部的RAG-QA框架,包含:(1) 将原始多模态文档转化为结构化语料库与问答对的数据流水线;(2) 完全本地部署、隐私保护的架构;(3) 轻量级引用匹配器,实现答案段落与支撑内容的精准关联。在汽车领域应用中,该系统在人类与LLM评判下,事实正确性提升1.79~1.94分,信息量提升1.33~1.16分,帮助度提升1.08~1.67分,均基于1-5分评分体系。

原文摘要 · Abstract (English)

Proprietary corporate documents contain rich domain-specific knowledge, but their overwhelming volume and disorganized structure make it difficult even for employees to access the right information when needed. For example, in the automotive industry, vehicle crash-collision tests, each costing hundreds of thousands of dollars, produce highly detailed documentation. However, retrieving relevant content during decision-making remains time-consuming due to the scale and complexity of the material. While Retrieval-Augmented Generation (RAG)-based Question Answering (QA) systems offer a promising solution, building an internal RAG-QA system poses several challenges: (1) handling heterogeneous multi-modal data sources, (2) preserving data confidentiality, and (3) enabling traceability between each piece of information in the generated answer and its original source document. To address these, we propose a RAG-QA framework for internal enterprise use, consisting of: (1) a data pipeline that converts raw multi-modal documents into a structured corpus and QA pairs, (2) a fully on-premise, privacy-preserving architecture, and (3) a lightweight reference matcher that links answer segments to supporting content. Applied to the automotive domain, our system improves factual correctness (+1.79, +1.94), informativeness (+1.33, +1.16), and helpfulness (+1.08, +1.67) over a non-RAG baseline, based on 1-5 scale ratings from both human and LLM judge.

企业问答RAG隐私保护知识管理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。