一种统一多种数据库的新型索引框架，支持复杂数据查询与高并发事务。
Annotative Indexing
- 用统一索引框架融合倒排、列存、图数据库等技术
- 支持文本、JSON等多类型数据的SQL-like查询
- 可动态更新并保障事务一致性，支持数百并发读写
本文提出注解索引（annotative indexing），一种统一并泛化传统倒排索引、列式存储、对象存储和图数据库的新框架。该框架可作为支持检索增强生成、知识图谱、实体检索、半结构化数据及排序检索的数据库底层索引。虽然主要面向文本类人类语言数据，但其通用性足以支持多种数据类型，并展示了包含数字和日期的JSON存储上执行SQL-like查询的实例。利用注解索引的灵活性，还实现了完全动态的索引系统，支持具备ACID特性的事务处理，可容纳数百个并发读者与写者。
原文摘要 · Abstract (English)
This paper introduces annotative indexing, a novel framework that unifies and generalizes traditional inverted indexes, column stores, object stores, and graph databases. As a result, annotative indexing can provide the underlying indexing framework for databases that support retrieval augmented generation, knowledge graphs, entity retrieval, semi-structured data, and ranked retrieval. While we primarily focus on human language data in the form of text, annotative indexing is sufficiently general to support a range of other datatypes, and we provide examples of SQL-like queries over a JSON store that includes numbers and dates. Taking advantage of the flexibility of annotative indexing, we also demonstrate a fully dynamic annotative index incorporating support for ACID properties of transactions with hundreds of multiple concurrent readers and writers.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。