arXiv:2412.10422cs.CLcs.AI2024-12被引 12

让AI自动理解问题,智能准备表格数据,提升问答准确率。

AutoPrep: Natural Language Question-Aware Data Preparation with a Multi-Agent Framework

  • 用多个专业代理协同处理数据准备任务
  • 通过逻辑规划、代码生成和执行三步精准处理表格
  • 适合需要从复杂表格中快速获取答案的研究者

回答关于表格的自然语言问题(即表格问答,TQA)至关重要,它使用户能高效从结构化数据中提取洞察,弥合人类语言与机器可读格式之间的鸿沟。许多表格来自网络或真实场景,需细致的数据准备以确保回答准确。但针对自然语言问题的数据准备引入了新要求,不仅限于传统清洗,还需根据问题进行列推导、筛选、值归一化或转换等操作,凸显出对更精细方法的需求。由于各项任务特性各异,单一模型难以胜任所有场景。本文提出AutoPrep——一种基于大语言模型的多代理框架,利用多个各司其职的代理,提升数据准备的准确性和上下文相关性。给定一个自然语言问题,AutoPrep通过三个核心组件完成数据准备:规划器(Planner)生成高层操作逻辑计划;程序员(Programmer)将逻辑计划转化为低层代码;执行器(Executor)运行生成代码处理表格。为支持该框架,我们设计了新的‘链式条款’推理机制用于高层操作建议,并采用工具增强的方法生成底层代码。

原文摘要 · Abstract (English)

Answering natural language (NL) questions about tables, known as Tabular Question Answering (TQA), is crucial because it allows users to quickly and efficiently extract meaningful insights from structured data, effectively bridging the gap between human language and machine-readable formats. Many of these tables are derived from web sources or real-world scenarios, which require meticulous data preparation (or data prep) to ensure accurate responses. However, preparing such tables for NL questions introduces new requirements that extend beyond traditional data preparation. This question-ware data preparation involves specific tasks such as column derivation and filtering tailored to particular questions, as well as question-aware value normalization or conversion, highlighting the need for a more nuanced approach in this context. Because each of the above tasks is unique, a single model (or agent) may not perform effectively across all scenarios. In this paper, we propose AutoPrep, a large language model (LLM)-based multiagent framework that leverages the strengths of multiple agents, each specialized in a certain type of data prep, ensuring more accurate and contextually relevant responses. Given an NL question over a table, AutoPrep performs data prep through three key components. Planner: Determines a logical plan, outlining a sequence of high-level operations. Programmer: Translates this logical plan into a physical plan by generating the corresponding low-level code. Executor: Executes the generated code to process the table. To support this multi-agent framework, we design a novel Chain-ofClauses reasoning mechanism for high-level operation suggestion, and a tool-augmented method for low-level code generation.

表格问答多代理数据准备LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。