arXiv:2603.16189cs.CV2026-03被引 4

通过多任务多奖励强化学习,让SVG生成模型显式推理并输出更优代码。

Reliable Reasoning in SVG-LLMs via Multi-Task Multi-Reward Reinforcement Learning

  • 引入思维链机制,显式暴露生成过程中的逻辑推理。
  • 在14.5万样本数据集上训练,提升结构一致性和视觉保真度。
  • 适合需要高质量可读代码的图形生成研究者或开发者。

随着视觉-语言模型的快速发展,越来越多研究探索其在SVG生成任务中的潜力。尽管现有方法通过构建大规模SVG数据集和引入特定符号提升了性能,但仍存在泛化能力有限、代码中冗余路径多、缺乏明确推理过程等问题。本文提出CTRL-S(基于思维链的强化学习用于SVG生成),一个统一框架,通过引入思维链机制,在生成过程中显式展现模型的推理流程。为支持结构化推理,我们构建了包含14.5万样本的SVG-Sophia数据集,覆盖代码优化、文本到SVG、图像到SVG三类任务。通过训练模型生成分组结构化的SVG代码,CTRL-S显著提升了结构连贯性与视觉保真度。此外,采用GRPO算法并设计多奖励优化框架,融合DINO、图文相似性、格式规范性及代码效率四项奖励。通过联合多奖励优化与多任务训练,系统性增强整体生成能力。大量实验表明,CTRL-S优于现有方法,在任务成功率、代码质量与视觉保真度方面均表现优异。

原文摘要 · Abstract (English)

With the rapid advancement of vision-language models, an increasing number of studies have explored their potential for SVG generation tasks. Although existing approaches improve performance by constructing large-scale SVG datasets and introducing SVG-specific tokens, they still suffer from limited generalization, redundant paths in code outputs, and a lack of explicit reasoning. In this work, we present CTRL-S (Chain-of-Thought Reinforcement Learning for SVG), a unified framework that introduces a chain-of-thought mechanism to explicitly expose the model's reasoning process during SVG generation. To support this structured reasoning, we construct SVG-Sophia, a high-quality dataset containing 145K samples across SVG code refinement, Text-to-SVG, and Image-to-SVG tasks. By training the model to generate group-level structured SVG code, CTRL-S significantly improves structural coherence and visual fidelity. Furthermore, we adopt the GRPO algorithm and design a multi-reward optimization framework, incorporating DINO, image-text similarity, format, and code efficiency rewards. Through joint multi-reward optimization and multi-task training, our approach systematically enhances overall generation capabilities. Extensive experiments show that CTRL-S outperforms existing methods, achieving higher task success rates, superior SVG code quality, and exceptional visual fidelity.

SVG生成强化学习思维链多任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。