用CLIP实现轻量级图像搜索，科研人员可自建检索工具
CLIPSE -- a minimalistic CLIP-based image search engine for research
- 基于CLIP嵌入实现图文联合搜索
- 小规模数据下索引与查询均在秒级完成
- 架构简洁易扩展，适合科研场景快速部署
本文简要介绍CLIPSE，一个面向研究用途的自托管图像搜索引擎。CLIPSE利用CLIP嵌入对图像和文本查询进行处理，整体框架设计简洁，便于扩展与使用。文中描述并评估了两个基准场景，涵盖索引与查询时间。结果表明，CLIPSE能够高效处理小规模数据集；对于更大规模数据，建议采用多实例分布式方案。
原文摘要 · Abstract (English)
A brief overview of CLIPSE, a self-hosted image search engine with the main application of research, is provided. In general, CLIPSE uses CLIP embeddings to process the images and also the text queries. The overall framework is designed with simplicity to enable easy extension and usage. Two benchmark scenarios are described and evaluated, covering indexing and querying time. It is shown that CLIPSE is capable of handling smaller datasets; for larger datasets, a distributed approach with several instances should be considered.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。