评测大模型编辑科学图表代码的能力,发现现有模型普遍不可靠。
Edit2TikZ: A Comprehensive and Challenging Benchmark for Scientific Figure Editing with TikZ

- 构建包含1548个样本的综合评测集,支持多步编辑与图文定位。
- 主流模型平均编译成功率仅75%,小模型不足50%且易出错。
- 提出新训练方法,使小模型编译成功率提升至83.4%,效果显著。
尽管多模态大模型在视觉理解与图形代码生成方面展现出巨大潜力,但通过代码编辑科学图表仍具挑战:模型需同时恢复视觉结构、准确理解修改指令、生成可编译代码,并保留无关内容。现有TikZ评测多集中于图像重建与生成,缺乏对指令引导下的可编译代码编辑的系统评估。本文提出Edit2TikZ,一个涵盖1548个多样且高质量样本的综合性科学图表编辑基准,融合真实场景与受控合成编辑案例,支持文本与视觉定位,每步编辑均带层级标注。我们构建了人类对齐的评估框架,衡量修改是否完成且非相关部分被保留。基于此,我们评估了14个主流多模态大模型,发现当前系统仍不可靠:平均编译成功率为75%,且在图还原与编辑正确性上受限;9B以下紧凑模型在指令遵循和完整生成方面表现更差。为此,我们构建了混合训练集TikZEditMix,并采用‘重建-再编辑’课程学习策略优化小模型。在Qwen3.5-4B上,编译成功率从45.35%提升至83.40%,各项指标平均提升18.7分。代码与数据将开源。
原文摘要 · Abstract (English)
Although multimodal large language models (MLLMs) have shown substantial potential in visual understanding and graphic code generation, editing scientific figures through code presents a greater challenge: a model must jointly recover visual structure, ground the requested change, generate compilable code, and preserve all unrelated content. While existing TikZ benchmarks mainly focus on figure reconstruction and generation, few systematically evaluate instruction-guided scientific figure editing with compilable code. We introduce Edit2TikZ, a comprehensive benchmark for scientific figure editing tasks, featuring 1,548 diverse and high-quality samples. Edit2TikZ combines real-world and controlled synthetic edit cases, supports both textual and visual localization request, and contains multi-step editing, each with step-level annotations. We further construct a human-aligned evaluation framework to measure whether a requested edit is completed while irrelevant content is preserved. Utilizing Edit2TikZ, we evaluate 14 mainstream MLLMs and find that current systems remain unreliable: on average, proprietary models achieve a compilation success rate of merely 75% and remain limited in both figure restoration and edit correctness, while compact models below 9B struggle further with instruction following and complete figure generation. Therefore, we build a mixed training set TikZEditMix and adopt reconstruction-then-editing curriculum learning for compact models. On Qwen3.5-4B, this training improves the compilation success rate from 45.35% to 83.40% and yields an average improvement of 18.7 points across our proposed evaluation metrics. The code and data will be released at https://github.com/Solunny/Edit2TikZ.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。