用2D场预测笔画绘制顺序，实现可控矢量草图生成
Draw This First
- 反向设计：用2D场定义笔画绘制顺序而非逐笔生成
- 支持文本描述或图像还原生成有序矢量草图
- 可按指令控制笔画顺序，适合创意设计与交互应用
我们反转了传统草图生成的范式：不再按顺序绘制笔画，而是预测一个二维场来定义笔画的绘制顺序。采用预训练的潜在流匹配变换器提供图像先验以预测中间表示，同时训练VAE解码器预测顺序场、笔画掩码和笔画分割。将预测的分割结果向量化为折线，并根据场值排序，生成有序矢量草图。模型可从文本描述生成有序矢量草图，或从图像反渲染为有序向量；两种情形均能遵循文本指令指定的绘制顺序。
原文摘要 · Abstract (English)
We invert the typical formulation of sketch generation: instead of drawing strokes in order, we predict a 2D field that defines the order in which strokes are drawn. We use a pretrained latent flow-matching transformer to supply the image prior to predict an intermediate representation, while training the VAE's decoder to predict the order field, stroke mask, and stroke segmentation. We vectorize the predicted segmentation into polylines and sort them by the field, producing an ordered vector sketch. Our model can predict an ordered vector sketch from a text description or derender an image into ordered vectors; for either, it follows text instructions specifying the order of drawing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。