arXiv:2509.02751cs.AIcs.DB2025-09被引 9

让AI分析系统兼具效率与灵活性,实现智能查询优化。

Deep Research is the New Analytics System: Towards Building the Runtime for AI-Driven Analytics

  • 用深度研究代理自动生成并优化语义操作程序。
  • 相比手工代码,查询准确率提升最高达1.95倍。
  • 适合需要高效交互式分析的科研与数据产品团队。

随着大语言模型(LLM)的发展,研究人员正构建可在大规模非结构化数据上执行人工智能驱动分析的新系统。现有工作探索使用语义操作符——一种以自然语言描述的AI赋能数据转换集合——来执行分析查询。然而,即使经过优化,这些操作符在百万级记录上执行仍成本高昂,且其迭代执行机制不适用于交互式分析任务。另一方向的深度研究系统已展示出通过一个或多个LLM代理规划、处理数据并迭代改进答案的能力。但这些系统缺乏对查询计划的显式优化,可能导致执行效率低下。为使AI驱动分析更优,我们需要融合语义操作符的高效执行与深度研究系统的灵活性和动态性。作为迈向此愿景的第一步,我们构建了一个原型,使深度研究代理能够编写并执行优化后的语义操作符程序。评估表明,该原型在两个基础查询上优于手工编写的语义操作符程序及开放的深度研究系统。相比标准开放深度研究代理,其F1得分最高提升1.95倍。即使允许代理调用语义操作符作为工具,本原型仍实现高达76.8%的成本降低和72.7%的运行时间节省,归功于其优化的执行机制。

原文摘要 · Abstract (English)

With advances in large language models (LLMs), researchers are creating new systems that can perform AI-driven analytics over large unstructured datasets. Recent work has explored executing such analytics queries using semantic operators -- a declarative set of AI-powered data transformations with natural language specifications. However, even when optimized, these operators can be expensive to execute on millions of records and their iterator execution semantics make them ill-suited for interactive data analytics tasks. In another line of work, Deep Research systems have demonstrated an ability to answer natural language question(s) over large datasets. These systems use one or more LLM agent(s) to plan their execution, process the dataset(s), and iteratively refine their answer. However, these systems do not explicitly optimize their query plans which can lead to poor plan execution. In order for AI-driven analytics to excel, we need a runtime which combines the optimized execution of semantic operators with the flexibility and more dynamic execution of Deep Research systems. As a first step towards this vision, we build a prototype which enables Deep Research agents to write and execute optimized semantic operator programs. We evaluate our prototype and demonstrate that it can outperform a handcrafted semantic operator program and open Deep Research systems on two basic queries. Compared to a standard open Deep Research agent, our prototype achieves up to 1.95x better F1-score. Furthermore, even if we give the agent access to semantic operators as tools, our prototype still achieves cost and runtime savings of up to 76.8% and 72.7% thanks to its optimized execution.

AI分析大模型查询优化语义操作符

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。