arXiv:2601.21694cs.CV2026-01被引 1

构建首个端到端图表编辑基准,评估模型直接理解指令改图的能力。

ChartE$^{3}$: A Comprehensive Benchmark for End-to-End Chart Editing

  • 直接评估模型从指令生成修改后图表,无需中间语言或代码
  • 覆盖1200+样本,区分局部微调与全局数据重构两类任务
  • 揭示当前大模型在复杂数据编辑上仍有显著能力短板

图表是结构化数据分析的基础可视化形式。实现根据用户意图的端到端图表编辑具有重要实用价值,但因需兼顾细粒度控制与整体结构一致性而极具挑战。现有方法多采用流水线式设计,以自然语言或代码作为中间表示,限制了对复杂编辑的准确执行。我们提出ChartE$^{3}$,一个端到端图表编辑基准,直接评估模型性能,不依赖中间自然语言程序或代码监督。该基准聚焦两个互补维度:局部编辑(如字体、颜色调整)与全局编辑(如数据过滤、趋势线添加)。ChartE$^{3}$包含超过1200个高质量样本,通过精心设计的数据管道与人工校验生成。每个样本以图表图像、底层代码和多模态编辑指令三元组形式提供,支持客观与主观双重评估。对前沿多模态大模型的广泛评测显示,在全局编辑任务上存在显著性能差距,凸显当前端到端图表编辑能力的关键瓶颈。

原文摘要 · Abstract (English)

Charts are a fundamental visualization format for structured data analysis. Enabling end-to-end chart editing according to user intent is of great practical value, yet remains challenging due to the need for both fine-grained control and global structural consistency. Most existing approaches adopt pipeline-based designs, where natural language or code serves as an intermediate representation, limiting their ability to faithfully execute complex edits. We introduce ChartE$^{3}$, an End-to-End Chart Editing benchmark that directly evaluates models without relying on intermediate natural language programs or code-level supervision. ChartE$^{3}$ focuses on two complementary editing dimensions: local editing, which involves fine-grained appearance changes such as font or color adjustments, and global editing, which requires holistic, data-centric transformations including data filtering and trend line addition. ChartE$^{3}$ contains over 1,200 high-quality samples constructed via a well-designed data pipeline with human curation. Each sample is provided as a triplet of a chart image, its underlying code, and a multimodal editing instruction, enabling evaluation from both objective and subjective perspectives. Extensive benchmarking of state-of-the-art multimodal large language models reveals substantial performance gaps, particularly on global editing tasks, highlighting critical limitations in current end-to-end chart editing capabilities.

图表生成多模态基准测试

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。