让像素图变可编辑,突破图像生成的使用瓶颈
DrawAI: Agentic Benchmark and Workflow for Making Raster Images Editable

- 提出双阶段智能流程,将图片转为可编辑代码
- 在4类真实场景中验证,提升编辑性同时保持视觉一致
- 提供评测基准,适合研究生成式设计与交互工具的开发者
近期的图像生成模型和多模态智能体能完成越来越复杂的视觉任务,但其输出的位图仍难以直接使用,因为内容与关系被压缩为像素,无法进行检查、修改、重组或复用。本文提出图像到可编辑重构任务,旨在从位图中恢复出结构化、可直接操作的图形,同时保留视觉与语义内容。核心挑战在于兼顾保真度与可编辑性,二者常存在权衡。为此,我们构建了DrawAI系统,包含一个智能体评测基准DrawAI-Bench和一套重构工作流DrawAI-Flow。DrawAI-Bench覆盖科学图表、演示文稿、海报和示意图,融合真实与生成图像,反映实际创作场景。通过39项混合评估标准——包括规则匹配指标与针对特定资产的视觉语言评分——衡量保真度与可编辑性。此外,我们提出DrawAI-Flow,一种两阶段智能体工作流:解析代理将提取元素转化为明确的重构计划,重建代理通过迭代的代码-渲染-验证-修正循环生成可执行图形代码。我们在DrawAI-Bench上对13个模型在5种智能体框架下进行系统评估,结果显示不同模型-框架组合的重构质量与成本差异显著,而DrawAI-Flow始终提升可编辑结构。
原文摘要 · Abstract (English)
Recent image-generation models and multimodal agents can produce high-quality visuals for increasingly complex visual communication tasks. Yet their raster outputs remain difficult to use directly because meaningful content and relationships are flattened into pixels, preventing users from inspecting, modifying, rearranging, or reusing individual components. We formulate image-to-editable reconstruction, which recovers a structured, directly manipulable artifact from a raster image while preserving its visual and semantic content. The central challenge is to jointly satisfy Fidelity and Editability, which often trade off in practice. To study this task, we introduce DrawAI, comprising an agentic benchmark, DrawAI-Bench, and a reconstruction workflow, DrawAI-Flow. DrawAI-Bench spans scientific figures, presentation slides, posters, and diagrams, combining real and AI-generated images to reflect practical visual-creation scenarios. It evaluates Fidelity and Editability through a hybrid protocol of 39 criteria: deterministic rule-based metrics measure properties with direct correspondences, while asset-specific vision-language rubrics capture semantic and perceptual qualities for which exact matching is misleading. Besides, we propose DrawAI-Flow, a two-stage agentic workflow in which a Parser Agent turns extracted elements evidence into an explicit reconstruction plan, and a Reconstruction Agent realizes the plan as executable graphics code through an iterative code-render-validate-revise loop. On DrawAI-Bench, we systematically evaluate thirteen models across five agent harnesses to study the effects of model capability, harness choice, and workflow design. The results show that reconstruction quality and costs vary substantially across model-harness configurations, while DrawAI-Flow consistently improves editable structure.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。