arXiv:2512.19173cs.CLcs.CV2025-12

让图表生成与理解双向互验,提升模型泛化能力。

CycleChart: A Unified Consistency-Based Learning Framework for Bidirectional Chart Understanding and Generation

  • 以单个数据实例为循环核心,统一生成与解析流程。
  • 在四个任务上均达强效果,跨任务迁移性能显著提升。
  • 适合需要多任务协同的智能图表系统研发者。

当前图表相关任务如图表生成(NL2Chart)、图表模式解析、数据解析和图表问答(ChartQA)通常孤立研究,阻碍模型学习图表创建与解读间的共享语义。我们提出CycleChart,一种基于一致性学习的双向图表理解与生成统一框架。不同于传统多任务方法独立采样,CycleChart围绕每个数据实例组织所有任务:从源表和自然语言查询出发,模型生成图表规范,渲染并执行后,再从图表图像中恢复模式与底层数据。此实例级生命周期设计使模型捕捉从原始数据到视觉编码再到结构化恢复的完整转换链,并通过生成-解析一致性目标强制正向生成与反向解析的语义对齐。为支持该框架,我们构建了CycleChart-Bench,一个生命周期对齐的基准数据集,每个图表样本均含生成、模式解析、数据解析与问答的对齐标注。CycleChart在全部四项任务中表现优异,且能有效迁移到未见外部基准,展现出更强的跨任务泛化能力,标志着迈向更通用图表理解模型的重要一步。

原文摘要 · Abstract (English)

Current chart-related tasks, such as chart generation (NL2Chart), chart schema parsing, chart data parsing, and chart question answering (ChartQA), are typically studied in isolation, preventing models from learning the shared semantics that link chart creation and interpretation. We introduce CycleChart, a consistency-based learning framework for bidirectional chart understanding and generation. Unlike conventional multi-task approaches that draw training samples independently across tasks, CycleChart organizes all tasks around each single data instance. From a source table and natural-language query, the model generates a chart specification, renders and executes it, then learns to recover the schema and underlying data from the resulting chart image. This per-instance lifecycle design lets the model capture the full chain of transformations, from raw data through visual encoding to structured recovery, and a generate--parse consistency objective enforces semantic alignment between the forward generation and reverse parsing directions. To support this framework, we construct CycleChart-Bench, a lifecycle-aligned benchmark where every chart sample carries aligned annotations for generation, schema parsing, data parsing, and question answering. CycleChart achieves strong results across all four tasks and transfers effectively to unseen external benchmarks, demonstrating improved cross-task generalization and marking a step toward more general chart understanding models.

图表生成多任务学习一致性学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。