ARCADE实现实时多模态数据高效处理，支持混合查询与持续检索。
ARCADE: A Real-Time Data System for Hybrid and Continuous Query Processing across Diverse Data Modalities
- 基于LSM存储的统一索引，覆盖向量、空间和文本数据
- 读密集场景下性能最高提升7.4倍，写密集场景提升1.4倍
- 适合需要实时多模态分析的系统开发者与研究人员
多模态数据（包括文本、图像、视频、空间和关系数据）的爆炸式增长，叠加对这些数据进行实时语义搜索与检索的需求，已超出现有多模态实时数据库系统的处理能力，其要么缺乏高效的摄入与持续查询能力，要么在支持复杂混合分析方面表现不足。我们提出ARCADE，一个实时数据系统，能够高效支持跨多种数据类型的高吞吐量摄入与表达性强的混合及连续查询。ARCADE引入了基于LSM存储的统一磁盘二级索引，适用于向量、空间和文本数据；设计了全面的成本优化器以支持混合查询；并构建了增量物化视图框架以实现高效持续查询。系统基于开源RocksDB存储与MySQL查询引擎，读密集工作负载下性能最高超越领先多模态系统7.4倍，写密集场景下提升1.4倍。
原文摘要 · Abstract (English)
The explosive growth of multimodal data - spanning text, image, video, spatial, and relational modalities, coupled with the need for real-time semantic search and retrieval over these data - has outpaced the capabilities of existing multimodal and real-time database systems, which either lack efficient ingestion and continuous query capability, or fall short in supporting expressive hybrid analytics. We introduce ARCADE, a real-time data system that efficiently supports high-throughput ingestion and expressive hybrid and continuous query processing across diverse data types. ARCADE introduces unified disk-based secondary index on LSM-based storage for vector, spatial, and text data modalities, a comprehensive cost-based query optimizer for hybrid queries, and an incremental materialized view framework for efficient continuous queries. Built on open-source RocksDB storage and MySQL query engine, ARCADE outperforms leading multimodal data systems by up to 7.4x on read-heavy and 1.4x on write-heavy workloads.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。