arXiv:2511.13478cs.CVcs.AI2025-11AAAI被引 2

用视觉语言模型将静态幻灯片图还原为可编辑的SVG格式

Semantic Document Derendering: SVG Reconstruction via Vision-Language Modeling

  • 基于视觉语言模型识别图文元素并生成结构化SVG
  • 重建后LPIPS达0.069,人类评估满意度82.9%
  • 适用于科研幻灯片、海报等多媒体文档的可编辑还原

幻灯片、海报等多媒体文档通常设计为可交互和易修改,但常以静态位图形式分发,限制了编辑与定制。恢复其可编辑性需将位图转换为结构化的矢量格式。然而,现有依赖低级几何原语(如曲线、多边形)的光栅转矢量方法在处理复杂文档时表现不佳,无法保留高层结构,导致图像与文本元素语义混淆。为此,我们提出SliDer框架,利用视觉语言模型(VLMs)将幻灯片位图还原为紧凑且可编辑的可缩放矢量图形(SVG)。SliDer检测并提取每个图像与文本元素的属性,并组织成连贯的SVG结构。关键在于,模型在推理过程中通过类似人类设计的迭代优化,生成更忠实于原始位图的SVG代码。此外,我们构建了Slide2SVG数据集,包含从真实科学演示文稿中收集的位图-SVG配对,以推动该领域研究。实验表明,SliDer的重建LPIPS为0.069,且在82.9%的人类评估对比中优于最强的零样本VLM基线。

原文摘要 · Abstract (English)

Multimedia documents such as slide presentations and posters are designed to be interactive and easy to modify. Yet, they are often distributed in a static raster format, which limits editing and customization. Restoring their editability requires converting these raster images back into structured vector formats. However, existing geometric raster-vectorization methods, which rely on low-level primitives like curves and polygons, fall short at this task. Specifically, when applied to complex documents like slides, they fail to preserve the high-level structure, resulting in a flat collection of shapes where the semantic distinction between image and text elements is lost. To overcome this limitation, we address the problem of semantic document derendering by introducing SliDer, a novel framework that uses Vision-Language Models (VLMs) to derender slide images as compact and editable Scalable Vector Graphic (SVG) representations. SliDer detects and extracts attributes from individual image and text elements in a raster input and organizes them into a coherent SVG format. Crucially, the model iteratively refines its predictions during inference in a process analogous to human design, generating SVG code that more faithfully reconstructs the original raster upon rendering. Furthermore, we introduce Slide2SVG, a novel dataset comprising raster-SVG pairs of slide documents curated from real-world scientific presentations, to facilitate future research in this domain. Our results demonstrate that SliDer achieves a reconstruction LPIPS of 0.069 and is favored by human evaluators in 82.9% of cases compared to the strongest zero-shot VLM baseline.

矢量重建视觉语言模型幻灯片处理SVG生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。