arXiv:2609.04034cs.CVcs.CL2026-09

用智能代理生成可编辑的网页级视觉设计,支持拖拽修改和精确排版。

Editable Visual Design

论文配图:Editable Visual Design
图 1 · 摘自论文原文
  • 通过代码代理分步生成独立视觉元素并写入原生HTML/CSS
  • 实现可编辑的分层结构与真实文本,支持图形界面拖拽调整
  • 复现人类设计师的创作过程,兼具美学与生产可用性

尽管基于扩散模型的GPT-Image-2和Nano-Banana展现出强大的视觉表现力,但其端到端生成的位图存在文本错误且无法分层编辑。而基于代码的视觉生成虽能实现精确布局控制,却缺乏全局审美判断且难以编码复杂视觉元素。为此,我们提出可编辑视觉设计新范式,由代码代理驱动:将视觉语言模型(VLM)作为‘创意大脑’,负责需求理解、任务规划与美学判断;图像生成模型则作为按需调用的‘视觉世界模拟器’,合成独立视觉资产。在‘先想象,再行动’的闭环流程中,代理生成孤立资产,编写原生HTML/CSS,并根据渲染反馈迭代优化设计。此外,代理设计回放能忠实还原专业设计师的创作与推理轨迹。最终系统输出具有分层结构和真实文本的可编辑成果,支持图形界面中的直观拖拽与布局调整。在海报、信息图等场景的验证表明,该范式成功兼顾精细美学与生产级可编辑性。

原文摘要 · Abstract (English)

While diffusion base models such as GPT-Image-2 and Nano-Banana exhibit remarkable visual expressiveness, their end-to-end generation inherently yields flattened bitmaps with error-prone text, precluding layer-wise post-editing. Conversely, code-based visual generation via Coding Agents provides precise layout control and decoupled layers, yet remains constrained by a lack of global aesthetic intuition and the difficulty of coding complex visual assets. To address this, we propose Editable Visual Design, a new paradigm driven by a Coding Agent. We designate the VLM as the ``creative brain'' for requirement comprehension, task planning, and aesthetic judgment, while utilizing the image generation model as an on-demand ``visual world simulator'' to synthesize standalone visual assets. Operating under an ``imagine first, then act'' closed-loop workflow, the agent generates isolated assets, writes native HTML/CSS, and iteratively refines the design against visual rendering feedback. Furthermore, Agent Design Replay faithfully reproduces the creative and reasoning trajectory akin to that of professional human designers. Ultimately, the system delivers editable artifacts with decoupled layers and real text, enabling users to perform intuitive mouse dragging and layout adjustments on a graphical user interface. Validations on posters, infographics, and other scenarios show that this paradigm successfully achieves both refined aesthetics and production-grade editability.

视觉生成代码代理可编辑设计人机协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。