arXiv:2511.20489cs.DBcs.LG2025-11中稿 · SIGMOD 2026 as ful…被引 2

通过声明式分解推理,显著减少多表连接的重复计算。

InferF: Declarative Factorization of AI/ML Inferences over Joins

  • 将推理计算分解为子任务,按需推送到连接树节点执行
  • 在真实数据集上实现最高11.3倍加速,降低整体计算与连接开销
  • 适合处理多源数据融合的复杂推理场景,如推荐系统

现实世界中的AI/ML工作流常需对来自多个数据集的特征向量进行连接后推理。为避免连接结果中重复记录引发的冗余计算,已有研究提出因子化机器学习,将计算分解为子任务并在各规范化数据集上独立执行。然而,现有方法未充分探讨其在多路连接场景下的应用。为此,我们提出全新的声明式系统InferF,专注于以可分析表达式形式表示的任意推理工作流在多路连接上的因子化。我们形式化该问题,灵活地将部分因子化计算下推至连接树中的合格节点,以最小化总体推理与连接开销,并提出两种算法:(1) 基于节点成本函数的贪心算法,评估将部分计算下推至某节点对整体延迟的影响;(2) 基于遗传算法的迭代枚举与评估策略,寻找优质因子化方案。我们在Meta开源数据库引擎Velox上实现InferF,基于真实数据集评估,观察到最高11.3倍性能提升,并系统总结了决定因子化能否带来收益的关键因素。

原文摘要 · Abstract (English)

Real-world AI/ML workflows often apply inference computations to feature vectors joined from multiple datasets. To avoid the redundant AI/ML computations caused by repeated data records in the join's output, factorized ML has been proposed to decompose ML computations into sub-computations to be executed on each normalized dataset. However, there is insufficient discussion on how factorized ML could impact AI/ML inference over multi-way joins. To address the limitations, we propose a novel declarative InferF system, focusing on the factorization of arbitrary inference workflows represented as analyzable expressions over the multi-way joins. We formalize our problem to flexibly push down partial factorized computations to qualified nodes in the join tree to minimize the overall inference computation and join costs and propose two algorithms to resolve the problem: (1) a greedy algorithm based on a per-node cost function that estimates the influence on overall latency if a subset of factorized computations is pushed to a node, and (2) a genetic algorithm for iteratively enumerating and evaluating promising factorization plans. We implement InferF on Velox, an open-sourced database engine from Meta, evaluate it on real-world datasets, observed up to 11.3x speedups, and systematically summarized the factors that determine when factorized ML can benefit AI/ML inference workflows.

AI推理多表连接因子化计算性能优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。