arXiv:2607.03440cs.IR2026-07

用大模型提升古籍档案的可读性与检索效果,让历史文献更易被理解。

Improving Access to Historical Archives with Real-time RAG-based Systems

论文配图:Improving Access to Historical Archives with Real-time RAG-based Systems
图 1 · 摘自论文原文
  • 用大模型优化古籍文字识别结果,降低错误率
  • 自然语言提问下检索准确率提升31.9%,相关性显著改善
  • 适合研究历史、数字人文的学者快速查找文献

数字化历史档案是庞大且多元的文化遗产库,但现有访问方式面临光学字符识别(OCR)噪声和僵化的关键词检索问题,影响检索质量。本文提出一个端到端档案处理与检索框架,将大语言模型(LLMs)融入档案处理流程。系统包含两个核心组件:(i) 基于LLM的OCR纠错模块,提升文本质量;(ii) 支持自然语言问答的语义检索与交叉编码重排序管道,结合检索增强生成(RAG)。评估基于涵盖三个世纪(1762–2001)的50万份瑞士报纸片段的历史档案数据集,共384个自然语言查询。实验表明,LLM修正使字符错误率(CER)降低44.52%,词错误率(WER)降低60.95%。更重要的是,下游检索性能显著提升:相比传统关键词基线,重排序管道使NDCG@10提高31.9%(从65.99%升至87.05%),答案正确性和上下文相关性均获统计显著提升。结果表明,将大模型集成至现有文档处理与检索流程,可使数字图书馆从静态存储转变为可交互、语义化搜索的智能系统。

原文摘要 · Abstract (English)

Digitized historical archives are large, heterogeneous cultural heritage repositories, but access methods for such archives face challenges such as noisy optical character recognition (OCR) output and rigid keyword-based retrieval, which limit retrieval quality. In this work, we present an end-to-end archival processing and retrieval framework that integrates large language models (LLMs) into the archival pipeline. Our system introduces two core components: (i) an LLM-based OCR refinement module that improves text quality, and (ii) a semantic retrieval and cross-encoder reranking pipeline supporting natural-language question answering via retrieval-augmented generation (RAG). Our evaluations are done on a historical archival dataset of 500,000 Swiss newspaper segments spanning over three centuries (1762 to 2001). Experiments are conducted across 384 natural-language test queries. Our results highlight that LLM refinements reduce OCR errors by up to 44.52% (CER) and 60.95% (WER). More importantly, this is accompanied by downstream information retrieval improvements. Compared to traditional keyword baselines, our reranking pipeline increases NDCG@10 by 31.9% (from 65.99% to 87.05%) and achieves statistically significant gains in both answer correctness and context relevance. These results demonstrate that integrating LLMs with established document processing and retrieval pipelines can elevate digital libraries from static repositories to interactive, semantically searchable archival systems.

历史档案大模型RAGOCR优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。