用多模态搜索破解考古文献检索难题
SARCH: Multimodal Search for Archaeological Archives
- 分块提取文本、图像、表格并分类索引
- 混合检索策略提升跨模态搜索准确率
- 适合考古研究者与数字人文学者使用
本文介绍一个面向古籍考古文献的多模态搜索系统。该语料库以扫描版PDF形式数字化，但扫描质量参差不齐。我们的管道针对多模态考古文档，提取并索引文本、图像（分为地图、照片、布局和其他）、表格。我们评估了多种检索策略，包括基于关键词的搜索、嵌入式模型以及结合两种模态最优结果的混合方法。报告并分析了初步结果，讨论了该领域未来的研究方向。
原文摘要 · Abstract (English)
In this paper, we describe a multi-modal search system designed to search old archaeological books and reports. This corpus is digitally available as scanned PDFs, but varies widely in the quality of scans. Our pipeline, designed for multi-modal archaeological documents, extracts and indexes text, images (classified into maps, photos, layouts, and others), and tables. We evaluated different retrieval strategies, including keyword-based search, embedding-based models, and a hybrid approach that selects optimal results from both modalities. We report and analyze our preliminary results and discuss future work in this exciting vertical.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。