arXiv:2511.19830cs.DBcs.AI2025-11被引 7

用大模型优化多模态查询,速度提升超85%。

Beyond Relational: Semantic-Aware Multi-Modal Analytics with LLM-Native Query Optimization

  • 用自然语言规则和随机搜索找最优查询路径
  • 通过改进分数选最佳大模型后端,平均降本76%
  • 适合需要语义理解的电商、医疗等场景

多模态分析有望变革电商、医疗、娱乐等领域。但传统关系型查询算子难以捕捉语义,限制了实际应用。我们提出Nirvana框架,结合可编程语义算子与逻辑/物理查询优化,专为大模型驱动的语义查询设计。其核心是代理式逻辑优化器,利用自然语言规则和随机游走探索海量语义等价查询计划;同时引入成本感知的物理优化器,基于新提出的改进分数指标选择最优LLM后端。为进一步提升效率,Nirvana还采用基于模型能力假设的计算复用与评估下推技术。在三个真实世界基准上的实验表明,Nirvana将端到端运行时间减少10%–85%,系统处理成本平均降低76%,在效率与可扩展性上均超越现有先进系统。

原文摘要 · Abstract (English)

Multi-modal analytical processing has the potential to transform applications in e-commerce, healthcare, entertainment, and beyond. However, real-world adoption remains elusive due to the limited ability of traditional relational query operators to capture query semantics. The emergence of foundation models, particularly the large language models (LLMs), opens up new opportunities to develop flexible, semantic-aware data analytics systems that transcend the relational paradigm. We present Nirvana, a multi-modal data analytics framework that incorporates programmable semantic operators while leveraging both logical and physical query optimization strategies, tailored for LLM-driven semantic query processing. Nirvana addresses two key challenges. First, it features an agentic logical optimizer that uses natural language-specified transformation rules and random-walk-based search to explore vast spaces of semantically equivalent query plans -- far beyond the capabilities of conventional optimizers. Second, it introduces a cost-aware physical optimizer that selects the most effective LLM backend for each operator using a novel improvement-score metric. To further enhance efficiency, Nirvana incorporates computation reuse and evaluation pushdown techniques guided by model capability hypotheses. Experimental evaluations on three real-world benchmarks demonstrate that Nirvana is able to reduce end-to-end runtime by 10%--85% and reduces system processing costs by 76% on average, outperforming state-of-the-art systems at both efficiency and scalability.

多模态分析大模型优化查询优化语义理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。