arXiv:2509.20781cs.LGcs.DB2025-09

Sig2Model用动态修正机制让可更新索引免于频繁重训,提升查询效率。

Sig2Model: A Boosting-Driven Model for Updatable Learned Indexes

  • 用局部sigmoid函数追踪数据分布变化,避免全局重训
  • 重训成本降20倍,查询速率提升3倍,内存减少1000倍
  • 适合高频更新的数据库系统,如实时分析场景

学习型索引(LIs)通过机器学习模型逼近排序数据的累积分布函数(CDF),在静态数据上表现优异。但在动态更新时,因需保持CDF总和为1而被迫全局重训,阻塞查询且限制每秒查询数(QPS)。现有方法无法有效缓解重训开销,难以适应现实中的频繁更新场景。本文提出Sig2Model,通过三项关键技术实现高效自适应:(1) 基于sigmoid提升的近似方法,以局部sigmoid函数动态调整模型,追踪数据分布偏移,同时保证误差有界并推迟全量重训;(2) 利用高斯混合模型(GMM)进行预更新训练,识别高更新概率区域,提前分配占位符加速更新;(3) 设计神经联合优化框架,通过梯度学习持续优化sigmoid集成与GMM参数。在真实与合成工作负载上评估,结果表明Sig2Model将重训成本降低最多20倍,QPS提升最高3倍,内存使用减少最多1000倍。

原文摘要 · Abstract (English)

Learned Indexes (LIs) represent a paradigm shift from traditional index structures by employing machine learning models to approximate the cumulative distribution function (CDF) of sorted data. While LIs achieve remarkable efficiency for static datasets, their performance degrades under dynamic updates: maintaining the CDF invariant (sum of F(k) equals 1) requires global model retraining, which blocks queries and limits the queries-per-second (QPS) metric. Current approaches fail to address these retraining costs effectively, rendering them unsuitable for real-world workloads with frequent updates. In this paper, we present Sig2Model, an efficient and adaptive learned index that minimizes retraining cost through three key techniques: (1) a sigmoid boosting approximation technique that dynamically adjusts the index model by approximating update-induced shifts in data distribution with localized sigmoid functions while preserving bounded error guarantees and deferring full retraining; (2) proactive update training via Gaussian mixture models (GMMs) that identifies high-update-probability regions for strategic placeholder allocation to speed up updates; and (3) a neural joint optimization framework that continuously refines both the sigmoid ensemble and GMM parameters via gradient-based learning. We evaluate Sig2Model against state-of-the-art updatable learned indexes on real-world and synthetic workloads, and show that Sig2Model reduces retraining cost by up to 20x, achieves up to 3x higher QPS, and uses up to 1000x less memory.

学习型索引数据库动态更新机器学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。