用多个智能体协作纠错,提升大模型表格推理准确性
Table-Critic: A Multi-Agent Framework for Collaborative Criticism and Refinement in Table Reasoning
- 四类智能体分工协作:判官找错、批评家分析、改进者优化、整理者提炼规律
- 自进化模板树积累错误知识,有效应对多样错误类型
- 在多个数据集上显著降低错误率,且推理过程更稳定高效
尽管大语言模型在各类推理任务中表现卓越,但在表格推理任务中仍难以保持多步推理过程的一致性。现有方法虽尝试多种分解策略,但缺乏有效机制识别并纠正中间步骤的错误,导致错误传播。为此,我们提出 Table-Critic,一种新型多智能体框架,通过协同批评与迭代优化,使推理过程收敛至正确解。框架包含四个专业智能体:判官(Judge)用于错误识别,批评家(Critic)提供全面批判,改进者(Refiner)优化推理流程,整理者(Curator)提炼模式。为应对多样且不可预测的错误类型,我们引入自进化模板树,通过经验驱动学习系统积累批判知识,并指导未来反思。大量实验表明,Table-Critic 在准确率和错误修正率方面均优于现有方法,同时保持计算效率,并显著降低解的退化率。
原文摘要 · Abstract (English)
Despite the remarkable capabilities of large language models (LLMs) in various reasoning tasks, they still struggle with table reasoning tasks, particularly in maintaining consistency throughout multi-step reasoning processes. While existing approaches have explored various decomposition strategies, they often lack effective mechanisms to identify and correct errors in intermediate reasoning steps, leading to cascading error propagation. To address these issues, we propose Table-Critic, a novel multi-agent framework that facilitates collaborative criticism and iterative refinement of the reasoning process until convergence to correct solutions. Our framework consists of four specialized agents: a Judge for error identification, a Critic for comprehensive critiques, a Refiner for process improvement, and a Curator for pattern distillation. To effectively deal with diverse and unpredictable error types, we introduce a self-evolving template tree that systematically accumulates critique knowledge through experience-driven learning and guides future reflections. Extensive experiments have demonstrated that Table-Critic achieves substantial improvements over existing methods, achieving superior accuracy and error correction rates while maintaining computational efficiency and lower solution degradation rate.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。