用思维图引导复杂图表问答,提升推理准确率。
GoT-CQA: Graph-of-Thought Guided Compositional Reasoning for Chart Question Answering
- 构建思维图分解问题,分步执行定位、数值与逻辑操作。
- 在ChartQA和PlotQA-D上显著优于现有模型,尤其擅长复杂问题。
- 适合需要精准数据推理的报表分析与智能助手场景。
图表问答(CQA)旨在基于可视化图表内容回答问题,在图表摘要、业务数据分析和数据报告生成中具有重要意义。由于强上下文依赖性和复杂的推理需求,该任务极具挑战性:前者要求严格依据图表视觉内容或内部数据作答,后者强调答案预测过程中的多种逻辑与数值推理。本文聚焦于CQA中的复杂推理问题,提出一种基于思维图(GoT)的组合式推理模型GoT-CQA。首先,将面向图表的问题转化为由定位、数值和逻辑操作节点组成的有向无环图,直观模拟人类解题思维过程;随后设计一个由思维图引导的高效自动组合推理框架,执行多步推理操作。在ChartQA和PlotQA-D数据集上的综合实验表明,GoT-CQA在复杂人工编写及推理类问题上表现卓越,显著优于最新主流基线模型。
原文摘要 · Abstract (English)
Chart Question Answering (CQA) aims at answering questions based on the visual chart content, which plays an important role in chart sumarization, business data analysis, and data report generation. CQA is a challenging multi-modal task because of the strong context dependence and complex reasoning requirement. The former refers to answering this question strictly based on the analysis of the visual content or internal data of the given chart, while the latter emphasizes the various logical and numerical reasoning involved in answer prediction process. In this paper, we pay more attention on the complex reasoning in CQA task, and propose a novel Graph-of-Thought (GoT) guided compositional reasoning model called GoT-CQA to overcome this problem. At first, we transform the chart-oriented question into a directed acyclic GoT composed of multiple operator nodes, including localization, numerical and logical operator. It intuitively reflects the human brain's solution process to this question. After that, we design an efficient auto-compositional reasoning framework guided by the GoT, to excute the multi-step reasoning operations in various types of questions. Comprehensive experiments on ChartQA and PlotQA-D datasets show that GoT-CQA achieves outstanding performance, especially in complex human-written and reasoning questions, comparing with the latest popular baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。