针对历史文档问答的噪声问题,提出混合检索增强生成方法。
Hybrid Retrieval-Augmented Generation for Robust Multilingual Document Question Answering
- 用语义扩展与多查询融合提升检索鲁棒性。
- 生成结果严格基于证据,无足够依据时明确拒绝回答。
- 适合处理多语言、低质量历史文本的问答任务。
大规模数字化项目释放了海量历史报纸资源,但计算访问仍受限于OCR错误、多语言拼写差异和语言演变。我们构建并评估了一个专为噪声历史文档设计的多语言检索增强生成问答流水线。方法包括:(i) 通过语义查询扩展与倒数排名融合(RRF)提升检索对词汇不匹配的鲁棒性;(ii) 设计强化证据约束且在证据不足时显式拒答的生成提示;(iii) 模块化架构支持组件系统评估。我们在命名实体识别与嵌入模型选择上进行综合消融实验,验证了实体抽取中句法一致性的重要性及稠密检索中的性能-效率平衡。端到端评估表明,该流水线能对有支持的查询生成可信答案,并正确拒绝无法回答的问题。混合检索策略提升了召回稳定性,尤其得益于RRF对不同查询形式间性能波动的平滑能力。代码与配置已公开,提供可复现的历史文档问答基础。
原文摘要 · Abstract (English)
Large-scale digitization initiatives have unlocked massive collections of historical newspapers, yet effective computational access remains hindered by OCR corruption, multilingual orthographic variation, and temporal language drift. We develop and evaluate a multilingual Retrieval-Augmented Generation pipeline specifically designed for question answering on noisy historical documents. Our approach integrates: (i) semantic query expansion and multi-query fusion using Reciprocal Rank Fusion to improve retrieval robustness against vocabulary mismatch; (ii) a carefully engineered generation prompt that enforces strict grounding in retrieved evidence and explicit abstention when evidence is insufficient; and (iii) a modular architecture enabling systematic component evaluation. We conduct comprehensive ablation studies on Named Entity Recognition and embedding model selection, demonstrating the importance of syntactic coherence in entity extraction and balanced performance-efficiency trade-offs in dense retrieval. Our end-to-end evaluation framework shows that the pipeline generates faithful answers for well-supported queries while correctly abstaining from unanswerable questions. The hybrid retrieval strategy improves recall stability, particularly benefiting from RRF's ability to smooth performance variance across query formulations. We release our code and configurations at https://anonymous.4open.science/r/RAGs-C5AE/, providing a reproducible foundation for robust historical document question answering.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。