arXiv:2503.23752cs.GRcs.CV2025-03AAAI被引 3

用联合笔画与距离图编码生成更清晰可辨的矢量草图。

StrokeFusion: Vector Sketch Generation via Joint Stroke-UDF Encoding and Latent Sequence Diffusion

  • 将笔画和距离图联合编码,构建高质量草图特征空间。
  • 在QuickDraw上生成效果优于当前最佳方法,保持结构完整性。
  • 支持笔画插值编辑,适合需要精细控制的创意设计场景。

在草图生成领域,基于栅格训练的模型常产生非笔画伪影,而基于矢量训练的模型通常缺乏对草图的整体理解,导致识别度下降。此外,现有方法难以从不同位置出现的相似元素(如动物的眼睛)中提取共性特征。为此,我们提出StrokeFusion,一种两阶段矢量草图生成框架。其包含双模态草图特征学习网络,将笔画映射至高质量潜在空间。该网络将草图分解为归一化笔画,并联合编码笔画序列与无符号距离函数(UDF)图,将草图表示为笔画特征向量集合。在此表征基础上,框架采用笔画级潜在扩散模型,生成时同步调整笔画的位置、尺度与轨迹。这不仅实现高保真草图生成,还支持笔画插值编辑。在QuickDraw数据集上的大量实验表明,本框架在保持结构完整性和语义特征方面优于当前最优技术。代码与模型将在发表后公开。

原文摘要 · Abstract (English)

In the field of sketch generation, raster-format trained models often produce non-stroke artifacts, while vector-format trained models typically lack a holistic understanding of sketches, leading to compromised recognizability. Moreover, existing methods struggle to extract common features from similar elements (e.g., eyes of animals) appearing at varying positions across sketches. To address these challenges, we propose StrokeFusion, a two-stage framework for vector sketch generation. It contains a dual-modal sketch feature learning network that maps strokes into a high-quality latent space. This network decomposes sketches into normalized strokes and jointly encodes stroke sequences with Unsigned Distance Function (UDF) maps, representing sketches as sets of stroke feature vectors. Building upon this representation, our framework exploits a stroke-level latent diffusion model that simultaneously adjusts stroke position, scale, and trajectory during generation. This enables high-fidelity sketch generation while supporting stroke interpolation editing. Extensive experiments on the QuickDraw dataset demonstrate that our framework outperforms state-of-the-art techniques, validating its effectiveness in preserving structural integrity and semantic features. Code and models will be made publicly available upon publication.

草图生成矢量建模扩散模型笔画编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。