arXiv:2505.20793cs.CVcs.AI2025-05NeurIPS被引 38

用渲染反馈强化学习,让AI生成更准确高效的矢量图。

Rendering-Aware Reinforcement Learning for Vector Graphics Generation

  • 通过渲染结果反馈优化自回归矢量图生成
  • 在多个数据集上显著优于监督微调方法
  • 适合需要高质量矢量图生成的设计师和开发者

可缩放矢量图形(SVG)作为一种可解释的代码形式,能高效表示视觉设计。近期基于视觉语言模型(VLM)的方法将SVG生成视为代码生成任务,利用大规模预训练实现高质量输出。这类模型能捕捉全局语义与细粒度视觉特征,并跨视觉、自然语言和代码领域迁移知识。然而,现有VLM方法在生成忠实且高效的SVG时表现不佳,因其训练过程中从未观察到渲染图像。尽管难以实现可微分渲染用于自回归生成,但仍可通过对比生成的渲染图像与原始输入来获得评估反馈,适用于强化学习。本文提出RLRF(基于渲染反馈的强化学习),通过将生成的SVG序列渲染后与原图比较,计算视觉保真度奖励,指导模型生成更精确、高效且语义一致的SVG。实验表明,RLRF显著优于监督微调,解决了常见失败模式,实现了具备强结构理解与泛化能力的高精度矢量图生成。

原文摘要 · Abstract (English)

Scalable Vector Graphics (SVG) offer a powerful format for representing visual designs as interpretable code. Recent advances in vision-language models (VLMs) have enabled high-quality SVG generation by framing the problem as a code generation task and leveraging large-scale pretraining. VLMs are particularly suitable for this task as they capture both global semantics and fine-grained visual patterns, while transferring knowledge across vision, natural language, and code domains. However, existing VLM approaches often struggle to produce faithful and efficient SVGs because they never observe the rendered images during training. Although differentiable rendering for autoregressive SVG code generation remains unavailable, rendered outputs can still be compared to original inputs, enabling evaluative feedback suitable for reinforcement learning (RL). We introduce RLRF (Reinforcement Learning from Rendering Feedback), an RL method that enhances SVG generation in autoregressive VLMs by leveraging feedback from rendered SVG outputs. Given an input image, the model generates SVG roll-outs that are rendered and compared to the original image to compute a reward. This visual fidelity feedback guides the model toward producing more accurate, efficient, and semantically coherent SVGs. RLRF significantly outperforms supervised fine-tuning, addressing common failure modes and enabling precise, high-quality SVG generation with strong structural understanding and generalization.

矢量图生成强化学习视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。