Rust实现的高效倒排索引库，查询速度最高快2倍。
RISE: A Rust Library for Inverted Index Search Engines
- 用Rust语言构建倒排索引，兼顾安全与高性能。
- 在多个数据集上测试，查询速度比现有方案快最多2倍。
- 适合信息检索研究者和需要高效搜索系统的开发者。
倒排索引是大规模文本中高效信息检索的关键数据结构，通过将每个词映射到其出现的文档，支持快速全文搜索。我们提出RISE，一个基于Rust实现的新型倒排索引库，旨在为信息检索任务提供高效率和高性能。RISE利用Rust的安全性和性能优势，构建了稳健的倒排索引构建与查询系统，并通过其丰富的特质系统提供灵活扩展能力。开发过程中，我们重新审视了倒排索引相关文献，使用该平台复现了多项既有成果。在多种数据集和工作负载下对RISE进行评估，结果表明其查询性能具有竞争力，相比当前最先进方案最快可提升2倍。实验显示，RISE是信息检索领域研究人员和实践者的有力工具。
原文摘要 · Abstract (English)
Inverted indexes are a crucial data structure for efficient information retrieval in large text corpora. They enable fast full-text search by mapping each term to the documents in which it appears, on top of which efficient algorithms quickly retrieve the documents relevant to a user query. We present RISE, a novel inverted index library implemented in Rust, designed to deliver high performance and efficiency for information retrieval tasks. RISE leverages Rust's safety and performance to provide a robust solution for building and querying inverted indexes, while offering accessible extensibility through its expressive trait system. While developing RISE, we revisited the inverted-index literature, thereby reproducing numerous prior works using this new test bench. We evaluated RISE against existing libraries, demonstrating competitive query performance across various datasets and workloads, with speedups of up to 2x over the current state of the art. Our results indicate that RISE is a promising tool for researchers and practitioners in the field of information retrieval.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。