用自然语言搜索数百万张数字藏品，让无标签档案也能轻松查找。
Digital Collections Explorer: An Open-Source, Multimodal Viewer for Searching Digital Collections
- 基于CLIP模型实现图文跨模态搜索，支持文字和图像反查。
- 可在M4芯片笔记本上高效运行超30万张图片的集合。
- 开源易部署，适合博物馆、档案馆等机构快速搭建检索系统。
我们提出Digital Collections Explorer，一个基于Web的开源探索式搜索平台，利用对比语言-图像预训练（CLIP）技术提升数字资源的视觉发现能力。该系统可本地安装并快速配置于本地磁盘上的视觉数据集，仅需几步即可运行。依托多模态搜索技术进展，其界面支持对数字收藏进行自然语言查询与反向图像搜索，利用视觉特征实现精准定位。本文介绍系统架构、实现方式及其在多种文化遗产数据集中的应用，展示了其在提升元数据匮乏档案访问性方面的潜力。通过地图、照片及网页存档中提取的PDF案例，验证了系统的灵活性与易用性。实验表明，该工具可在配备M4芯片的MacBook Pro上处理数十万张图像。我们还提供了公开演示版本供体验。
原文摘要 · Abstract (English)
We present Digital Collections Explorer, a web-based, open-source exploratory search platform that leverages CLIP (Contrastive Language-Image Pre-training) for enhanced visual discovery of digital collections. Our Digital Collections Explorer can be installed locally and configured to run on a visual collection of interest on disk in just a few steps. Building upon recent advances in multimodal search techniques, our interface enables natural language queries and reverse image searches over digital collections with visual features. This paper describes the system's architecture, implementation, and application to various cultural heritage collections, demonstrating its potential for democratizing access to digital archives, especially those with impoverished metadata. We present case studies with maps, photographs, and PDFs extracted from web archives in order to demonstrate the flexibility of the Digital Collections Explorer, as well as its ease of use. We demonstrate that the Digital Collections Explorer scales to hundreds of thousands of images on a MacBook Pro with an M4 chip. Lastly, we host a public demo of Digital Collections Explorer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。