用多个智能体协同推理,让表格问答更可靠高效
MATA: Multi-Agent Framework for Reliable and Flexible Table Question Answering
- 设计多智能体框架,通过不同推理路径生成答案
- 在10种LLM上测试,准确率达顶尖水平且减少大模型调用
- 适合资源受限场景,兼容多种小模型,部署灵活
大型语言模型(LLMs)虽显著提升了表格问答(TableQA)性能,但在可靠性、可扩展性和效率方面仍面临挑战,尤其在资源受限或隐私敏感环境中。本文提出MATA,一种多智能体表格问答框架,利用多个互补的推理路径和由小型语言模型构建的工具集。MATA通过多样化推理风格为给定表格与问题生成候选答案,并借助工具进行优化或选择最优答案。此外,引入算法以最小化昂贵的LLM调用,提升整体效率。MATA在十种不同LLM上表现优异,使用开源小模型即可保持强性能,并能轻松适配各类模型。在两个难度不同的基准数据集上的大量实验表明,MATA实现领先准确率与高推理效率,同时避免过度依赖大模型推理。结果证明,精心编排的多路径推理可带来可扩展、可靠的表格问答能力。代码已公开于https://github.com/AIDASLab/MATA。
原文摘要 · Abstract (English)
Recent advances in Large Language Models (LLMs) have significantly improved table understanding tasks such as Table Question Answering (TableQA), yet challenges remain in ensuring reliability, scalability, and efficiency, especially in resource-constrained or privacy-sensitive environments. In this paper, we introduce MATA, a multi-agent TableQA framework that leverages multiple complementary reasoning paths and a set of tools built with small language models. MATA generates candidate answers through diverse reasoning styles for a given table and question, then refines or selects the optimal answer with the help of these tools. Furthermore, it incorporates an algorithm designed to minimize expensive LLM agent calls, enhancing overall efficiency. MATA maintains strong performance with small, open-source models and adapts easily across various LLM types. Extensive experiments on two benchmarks of varying difficulty with ten different LLMs demonstrate that MATA achieves state-of-the-art accuracy and highly efficient reasoning while avoiding excessive LLM inference. Our results highlight that careful orchestration of multiple reasoning pathways yields scalable and reliable TableQA. The code is available at https://github.com/AIDASLab/MATA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。