arXiv:2506.03139cs.CVcs.AI2025-06被引 23

首个系统性评测SVG理解生成的基准,揭示大模型在复杂图形任务中的瓶颈。

SVGenius: Benchmarking LLMs in SVG Understanding, Editing and Generation

  • 构建覆盖24个真实场景的三阶段评测体系:理解→编辑→生成
  • 22个模型测试显示复杂度提升时性能普遍下降,风格迁移最难
  • 推理增强训练优于单纯扩大规模,适合图形智能研发人员参考

大型语言模型(LLMs)和多模态大模型在SVG处理上展现出潜力,但现有基准存在现实覆盖有限、复杂度分层不足和评估范式碎片化等问题。我们提出SVGenius,一个涵盖2,377个查询的综合性基准,包含三个渐进维度:理解、编辑与生成。基于24个应用领域的实际数据,采用系统性复杂度分层,通过8类任务和18项指标评估22个主流模型,覆盖不同规模、架构、训练范式及开放程度。分析表明,专有模型显著优于开源模型,但所有模型在复杂度上升时均出现系统性性能退化,暴露出当前方法的根本局限;然而,推理增强训练比单纯扩展规模更有效克服这些局限,而风格迁移仍是各类模型中最难的任务。SVGenius建立了首个系统性SVG处理评估框架,为开发更强大的矢量图形模型及推动自动化图形设计提供关键洞察。附录与补充材料(含全部数据与代码)可在https://zju-real.github.io/SVGenius获取。

原文摘要 · Abstract (English)

Large Language Models (LLMs) and Multimodal LLMs have shown promising capabilities for SVG processing, yet existing benchmarks suffer from limited real-world coverage, lack of complexity stratification, and fragmented evaluation paradigms. We introduce SVGenius, a comprehensive benchmark comprising 2,377 queries across three progressive dimensions: understanding, editing, and generation. Built on real-world data from 24 application domains with systematic complexity stratification, SVGenius evaluates models through 8 task categories and 18 metrics. We assess 22 mainstream models spanning different scales, architectures, training paradigms, and accessibility levels. Our analysis reveals that while proprietary models significantly outperform open-source counterparts, all models exhibit systematic performance degradation with increasing complexity, indicating fundamental limitations in current approaches; however, reasoning-enhanced training proves more effective than pure scaling for overcoming these limitations, though style transfer remains the most challenging capability across all model types. SVGenius establishes the first systematic evaluation framework for SVG processing, providing crucial insights for developing more capable vector graphics models and advancing automated graphic design applications. Appendix and supplementary materials (including all data and code) are available at https://zju-real.github.io/SVGenius.

SVG理解大模型评测图形生成多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。