arXiv:2605.05820cs.CV2026-05

用合成数据训练,零样本实现跨风格图表数据提取

ChartZero: Synthetic Priors Enable Zero Shot Chart Data Extraction

论文配图:ChartZero: Synthetic Priors Enable Zero Shot Chart Data Extraction
图 1 · 摘自论文原文
  • 仅用合成数据训练,避开真实标注瓶颈
  • 新损失函数解决曲线断裂问题,准确率提升显著
  • 适合需要跨风格、无标注数据的图表解析场景

自动化从折线图中提取数据仍受制于极端多样的视觉风格和严重匮乏的真实世界全标注数据集。现有端到端流程高度依赖昂贵的人工标注,难以泛化至任意美学风格与网格布局。模型在重构中存在两大关键失败模式:一是细长交叉曲线常导致结构断裂和细节丢失,因标准架构难以应对复杂背景;二是语义关联极易出错,现有方法依赖僵化的空间启发式规则,面对野外图表中不可预测的图例位置时极易失效。此外,评估协议多聚焦孤立子任务,无法衡量整体端到端重构效果。为此,我们提出ChartZero,一个利用合成先验实现鲁棒零样本图表数据提取的解析框架。通过仅在简单数学函数的纯合成数据集上训练,模型完全规避了真实世界标注瓶颈。我们提出全局正交实例(GOI)损失克服曲线断裂问题,并以开放词汇视觉语言模型(VLM)引导的图例匹配策略替代脆弱的空间规则。结合专为完整端到端重构设计的新度量和基准,实验表明ChartZero在无需真实监督的情况下显著推进了通用绘图数字化。代码与数据集将在录用后发布。

原文摘要 · Abstract (English)

Automated data extraction from line charts remains fundamentally bottlenecked by extreme stylistic diversity and a severe scarcity of comprehensively annotated, real-world datasets. Current end-to-end pipelines depend heavily on costly manual annotations, crippling their ability to generalize across arbitrary aesthetics and grid layouts. Furthermore, existing models suffer from two critical failure modes during reconstruction. First, extracting thin, intersecting curves frequently causes structural fragmentation and the erasure of fine visual details, as standard architectures struggle against complex backgrounds. Second, semantic association is notoriously error-prone; current pipelines rely on rigid spatial heuristics that easily break down against the unpredictable legend placements of in-the-wild charts. Finally, measuring true progress is hindered by evaluation protocols that assess isolated sub-tasks rather than holistic, end-to-end data reconstruction. To address these foundational issues, we introduce ChartZero, a parsing framework that leverages synthetic priors to enable robust zero-shot chart data extraction. By training exclusively on a purely synthetic dataset of simple mathematical functions, our model completely bypasses the real-world annotation bottleneck. We overcome curve fragmentation via a novel Global Orthogonal Instance (GOI) loss, and replace brittle spatial rules with an open-vocabulary, Vision-Language Model (VLM)-guided legend matching strategy. Accompanied by a new metric and benchmark specifically designed for full end-to-end reconstruction, our evaluations demonstrate that ChartZero significantly advances generalized plot digitization without requiring real-world supervision. Code and dataset will be released upon acceptance.

图表解析零样本学习合成数据视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。