arXiv:2608.10408cs.CL2026-08被引 1

评测视觉语言模型用多模态反馈修改可视化代码的能力,发现当前模型仍不成熟。

VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?

论文配图:VisEditBench: Can Vision-Language Models Edit Visualization Code from Multimodal Feedback?
图 1 · 摘自论文原文
  • 构建1395个真实场景的可视化代码编辑任务,覆盖修复与重风格两种场景。
  • 顶尖模型仅74.46%正确率,视觉风格迁移任务准确率不足56%。
  • 提出渲染驱动的编辑框架,通过试错验证提升代码修改准确性。

视觉语言模型(VLMs)在根据文本或图像生成可视化代码方面表现优异。然而,真实世界的可视化创作具有迭代性:用户常需修改已有图表以修复错误或调整风格。现有基准主要评估从零生成,缺乏对多模态反馈下代码编辑的评测。我们提出VisEditBench,一个包含1,395个由人工标注的可视化代码编辑任务的基准,基于真实工作流和常见错误案例。该基准涵盖两种实用场景:反馈引导修复(使用含错图表和文本反馈修正代码)与参考引导重风格(将代码修改为匹配目标图像)。评估20个先进VLM后发现,代码编辑仍具挑战:Claude-4.6-Sonnet最佳通过率为74.46%,多数开源模型低于50%。尤其在视觉锚定的风格迁移上,其准确率仅为55.71%。为此,我们提出VisEditAgent——一种基于渲染反馈的迭代式编辑框架,通过生成、执行、验证和优化候选修改来提升效果。基于GPT-4o的该框架将整体通过率从55.75%提升至67.99%,证明渲染反馈对精准编辑的重要性。数据集将公开于https://github.com/vis-nlp/VisEditBench。

原文摘要 · Abstract (English)

Vision-language models (VLMs) have shown strong capabilities in generating visualization code from textual or visual specifications. However, real-world visualization authoring is inherently iterative: users frequently revise existing visualizations to repair flawed charts or adapt them to desired styles. Existing benchmarks primarily evaluate generation from scratch, leaving visualization code editing from multimodal feedback largely unexplored. We introduce VisEditBench, a benchmark of 1,395 human-annotated visualization code-editing tasks grounded in realistic visualization workflows and failure cases. VisEditBench covers two practical settings: feedback-guided repair, where models revise visualization code using buggy or marked charts together with textual feedback, and reference-guided restyling, where models modify code to match a target chart image. Evaluating 20 state-of-the-art VLMs reveals that visualization code editing remains challenging: Claude-4.6-Sonnet achieves the best overall pass rate of 74.46%, while most open-source models remain below 50%. Performance is particularly weak on visually grounded style adaptation, where Claude-4.6-Sonnet achieves only 55.71%. To establish a strong baseline, we further propose VisEditAgent, a render-grounded editing framework that iteratively generates, executes, validates, and refines candidate edits. Built on GPT-4o, VisEditAgent improves overall pass rate from 55.75% to 67.99%, demonstrating the importance of render-grounded feedback for faithful visualization editing. We will release VisEditBench at https://github.com/vis-nlp/VisEditBench.

视觉语言模型可视化编辑多模态反馈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。