让大模型自动拆解并执行复杂数据分析任务,生成代码与可视化洞察。
ARTEMIS-DA: An Advanced Reasoning and Transformation Engine for Multi-Step Insight Synthesis in Data Analytics
- 分步规划+动态代码生成+可视化解析,三模块协同完成多步分析。
- 在WikiTableQuestions等基准上达到当前最优表现,精准处理复杂查询。
- 适合需要自动化数据洞察的科研与工业场景,提升分析效率。
本文提出一种名为ARTEMIS-DA的新型框架,用于增强大语言模型(LLMs)解决复杂多步骤数据解析任务的能力。该框架包含三个核心组件:规划器(Planner)将复杂用户查询分解为结构化、顺序化的指令,涵盖数据预处理、转换、预测建模和可视化;编码器(Coder)动态生成并执行对应的Python代码;绘图器(Grapher)解析生成的可视化结果,提炼可操作洞察。通过协调三者协作,ARTEMIS-DA有效管理涉及高级推理、多步转换及跨异构数据模态的复杂分析流程。在WikiTableQuestions和TabFact等基准测试中实现当前最优(SOTA)性能,展现出对复杂分析任务的高精度与强适应性。结合大模型推理能力、自动代码生成与执行、以及视觉分析,该框架提供了一种鲁棒且可扩展的多步洞察合成解决方案,广泛适用于各类数据科学挑战。
原文摘要 · Abstract (English)
This paper presents the Advanced Reasoning and Transformation Engine for Multi-Step Insight Synthesis in Data Analytics (ARTEMIS-DA), a novel framework designed to augment Large Language Models (LLMs) for solving complex, multi-step data analytics tasks. ARTEMIS-DA integrates three core components: the Planner, which dissects complex user queries into structured, sequential instructions encompassing data preprocessing, transformation, predictive modeling, and visualization; the Coder, which dynamically generates and executes Python code to implement these instructions; and the Grapher, which interprets generated visualizations to derive actionable insights. By orchestrating the collaboration between these components, ARTEMIS-DA effectively manages sophisticated analytical workflows involving advanced reasoning, multi-step transformations, and synthesis across diverse data modalities. The framework achieves state-of-the-art (SOTA) performance on benchmarks such as WikiTableQuestions and TabFact, demonstrating its ability to tackle intricate analytical tasks with precision and adaptability. By combining the reasoning capabilities of LLMs with automated code generation and execution and visual analysis, ARTEMIS-DA offers a robust, scalable solution for multi-step insight synthesis, addressing a wide range of challenges in data analytics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。