arXiv:2601.13606cs.CV2026-01ACL被引 8

自动生成复杂图表与可靠推理数据,解决视觉语言模型训练数据难题

ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch

  • 用新指标衡量图表复杂度,驱动程序生成多样化高复杂度图表
  • 答案先行构建问题,严格验证一致性,确保推理真实可信
  • 适合研究图文理解、复杂推理的开发者和研究人员使用

图表推理是视觉语言模型(VLMs)的关键能力。然而,开源模型的发展严重受限于高质量训练数据的缺乏。现有数据集面临双重挑战:合成图表通常过于简单重复,而对应的问答对容易产生幻觉且缺乏复杂任务所需的推理深度。为此,我们提出 ChartVerse,一个从零开始可扩展的框架,用于合成复杂图表与可靠的推理数据。首先,引入滚动后验熵(RPE)作为新指标,量化图表复杂度,并据此开发感知复杂度的图表编码器,通过可执行程序自主生成多样化的高复杂度图表。其次,为保证推理严谨性,提出基于答案锚定的逆向问答合成方法:先从源代码中提取确定性答案,再基于这些锚点生成问题,并强制进行一致性验证。为进一步提升难度与推理深度,依据模型失败率筛选样本,并蒸馏高质量的思维链(CoT)推理。我们使用 Qwen3-VL-30B-A3B-Thinking 作为教师模型,构建了 ChartVerse-SFT-600K 与 ChartVerse-RL-40K 数据集。实验表明,ChartVerse-8B 达到当前最优性能,显著超越其教师模型,并接近更强的 Qwen3-VL-32B-Thinking 模型。代码、模型权重与数据集已公开于 https://chartverse.github.io。

原文摘要 · Abstract (English)

Chart reasoning is a critical capability for Vision Language Models (VLMs). However, the development of open-source models is severely hindered by the lack of high-quality training data. Existing datasets suffer from a dual challenge: synthetic charts are often simplistic and repetitive, while the associated QA pairs are prone to hallucinations and lack the reasoning depth required for complex tasks. To bridge this gap, we propose ChartVerse, a scalable framework designed to synthesize complex charts and reliable reasoning data from scratch. (1) To address the bottleneck of simple patterns, we first introduce Rollout Posterior Entropy (RPE), a novel metric that quantifies chart complexity. Guided by RPE, we develop complexity-aware chart coder to autonomously synthesize diverse, high-complexity charts via executable programs. (2) To guarantee reasoning rigor, we develop truth-anchored inverse QA synthesis. Diverging from standard generation, we adopt an answer-first paradigm: we extract deterministic answers directly from the source code, generate questions conditional on these anchors, and enforce strict consistency verification. To further elevate difficulty and reasoning depth, we filter samples based on model fail-rate and distill high-quality Chain-of-Thought (CoT) reasoning. We curate ChartVerse-SFT-600K and ChartVerse-RL-40K using Qwen3-VL-30B-A3B-Thinking as the teacher. Experimental results demonstrate that ChartVerse-8B achieves state-of-the-art performance, notably surpassing its teacher and rivaling the stronger Qwen3-VL-32B-Thinking. We release our code, model weights, and datasets in https://chartverse.github.io.

图表推理程序生成数据合成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。