用可验证流程生成带问答的统计图表,提升LLM作图可靠性
Generating Statistical Charts with Validation-Driven LLM Workflows

- 分步工作流:筛选数据、提案绘图、生成代码、渲染验证、迭代优化
- 产出1500张图表,覆盖24类,配3万组问答,支持多模态模型评测
- 强调可检查性,适合研究图表理解与多模态推理的学者使用
从表格数据生成多样且可读的统计图表对大语言模型仍是挑战,因许多错误仅在渲染后显现,无法仅凭数据或代码发现。现有图表数据集也极少提供完整对齐的成果,如可执行代码、数据上下文和问答对。本文提出一种结构化的基于LLM的工作流,将图表生成分解为数据筛选、图表提案、代码合成、渲染、验证驱动优化、描述生成和问答生成等步骤。通过引入渲染结果验证,该流程有效应对可读性差和语义不符等可视化特有失败模式。它将图表生成视为可追溯的过程,保留每张图表及其代码、数据上下文、描述和问答对。应用于UCI数据集,该工作流生成了来自74个数据集的1500张图表,涵盖24种图表类型,并配有30,003个问答对。我们在此基础上评估了16个多模态大模型(MLLMs)。结果显示,图表语法类问题几乎已趋饱和,而数值提取、比较与推理仍具挑战,凸显该工作流在诊断图表基础多模态推理能力方面的价值。
原文摘要 · Abstract (English)
Generating diverse, readable statistical charts from tabular data remains challenging for LLMs, as many failures become apparent after rendering and are not detectable from data or code alone. Existing chart datasets also rarely provide fully aligned artifacts, such as executable code, dataset context, and question-answer pairs. We present a structured LLM-based workflow that decomposes chart generation into dataset screening, plot proposal, code synthesis, rendering, validation-driven refinement, description generation, and question-answer generation. By incorporating rendered-output validation, the workflow addresses visualization-specific failure modes such as readability and semantic mismatch. It treats chart generation as an inspectable process rather than a one-shot prompt-to-code task, retaining each chart with its code, dataset context, description, and question-answer pairs. Applied to UCI datasets, the workflow produces 1,500 charts from 74 datasets, spanning 24 chart families and paired with 30,003 question-answer pairs. We evaluate 16 multimodal LLMs (MLLMs) on these chart-question pairs. The results show that chart-syntax questions are nearly saturated, while value extraction, comparison, and reasoning remain more challenging, illustrating the workflow's utility for diagnostic studies of chart-grounded multimodal reasoning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。