arXiv:2510.27238cs.DBcs.AI2025-10中稿 · SIGMOD 2026被引 3

DRAMA让机器自动完成从数据收集到分析的全流程,高效回答开放领域问题。

DRAMA: Unifying Data Retrieval and Analysis for Open-Domain Analytic Queries

  • 统一数据检索、转换与分析为一个端到端流程
  • 在100个真实任务上准确率达86.5%,成本仅0.05美元
  • 适合需要快速分析公开数据的研究者和从业者

手动开展现实世界的数据分析耗时费力。尽管已有诸多自动化数据科学工作流尝试,但现有范式或系统均未充分具备三大核心能力:(1)开放域数据收集,(2)结构化数据转换,(3)分析推理。为此,我们提出DRAMA,一种端到端范式,可对大规模开放域数据上的自然语言分析查询作出响应。DRAMA将数据收集、转换与分析整合为单一流水线。为量化评估该范式在代表性任务上的表现,我们构建了基准数据集DRAMA-Bench,包含两类任务:事实验证与问答,每类各100个实例。这些任务源自具有广泛公众关注的真实应用场景,需对开放域数据进行检索与分析。我们开发了遵循DRAMA框架的多智能体系统DRAMA-Bot,由数据检索器协调子智能体执行数据收集与转换,以及数据分析师对获取数据进行结构化推理。我们在DRAMA-Bench上评估DRAMA-Bot,并与五个前沿基线智能体对比。DRAMA-Bot以0.05美元成本实现86.5%的任务准确率,优于所有基线,最高准确率提升达6.9倍,成本不足其1/6。DRAMA已开源,地址:https://github.com/uiuc-kang-lab/drama。

原文摘要 · Abstract (English)

Manually conducting real-world data analyses is labor-intensive and inefficient. Despite numerous attempts to automate data science workflows, none of the existing paradigms or systems fully demonstrate all three key capabilities required to support them effectively: (1) open-domain data collection, (2) structured data transformation, and (3) analytic reasoning. To overcome these limitations, we propose DRAMA, an end-to-end paradigm that answers users' analytic queries in natural language on large-scale open-domain data. DRAMA unifies data collection, transformation, and analysis as a single pipeline. To quantitatively evaluate system performance on tasks representative of DRAMA, we construct a benchmark, DRAMA-Bench, consisting of two categories of tasks: claim verification and question answering, each comprising 100 instances. These tasks are derived from real-world applications that have gained significant public attention and require the retrieval and analysis of open-domain data. We develop DRAMA-Bot, a multi-agent system designed following DRAMA. It comprises a data retriever that collects and transforms data by coordinating the execution of sub-agents, and a data analyzer that performs structured reasoning over the retrieved data. We evaluate DRAMA-Bot on DRAMA-Bench together with five state-of-the-art baseline agents. DRAMA-Bot achieves 86.5% task accuracy at a cost of $0.05, outperforming all baselines with up to 6.9 times the accuracy and less than 1/6 of the cost. DRAMA is publicly available at https://github.com/uiuc-kang-lab/drama.

数据分析多智能体开放域

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。