用AI自动设计数据库优化方案,突破人工瓶颈
AI-Driven Research for Databases

- 让AI协同进化出评估器,自动筛选最优优化代码
- 在缓冲区管理等任务中实现最高6.8倍延迟降低
- 适合想自动化提升数据库性能的研究者与工程师
随着现代工作负载和硬件复杂度迅速超越人类研究与工程能力,现有数据库性能优化方法难以跟上节奏。为此,我们提出AI驱动的系统研究(ADRS)新范式,利用大语言模型自动发现优化方案,将优化从手动设计转向自动代码生成。其核心挑战在于评估管道:由于框架可快速生成数百个候选方案而缺乏人工监督,亟需高效准确的评估反馈以收敛到有效解。针对复杂数据库系统的评估器构建难题,我们提出通过协同进化方式自动设计评估器。在缓冲区管理、查询重写和索引选择三个案例中验证了该方法的有效性。自动化评估器成功发现了优于现有基线的新算法(如确定性查询重写策略延迟降低达6.8倍),证明解决评估瓶颈能释放ADRS潜力,生成可部署于下一代数据系统的高度优化代码。
原文摘要 · Abstract (English)
As the complexity of modern workloads and hardware increasingly outpaces human research and engineering capacity, existing methods for database performance optimization struggle to keep pace. To address this gap, a new class of techniques, termed AI-Driven Research for Systems (ADRS), uses large language models to automate solution discovery. This approach shifts optimization from manual system design to automated code generation. The key obstacle, however, in applying ADRS is the evaluation pipeline. Since these frameworks rapidly generate hundreds of candidates without human supervision, they depend on fast and accurate feedback from evaluators to converge on effective solutions. Building such evaluators is especially difficult for complex database systems. To enable the practical application of ADRS in this domain, we propose automating the design of evaluators by co-evolving them with the solutions. We demonstrate the effectiveness of this approach through three case studies optimizing buffer management, query rewriting, and index selection. Our automated evaluators enable the discovery of novel algorithms that outperform state-of-the-art baselines (e.g., a deterministic query rewrite policy that achieves up to 6.8x lower latency), demonstrating that addressing the evaluation bottleneck unlocks the potential of ADRS to generate highly optimized, deployable code for next-generation data systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。