分步生成草图,支持绘制中任意调整笔画细节。
Generating Sketches in a Hierarchical Auto-Regressive Process for Flexible Sketch Drawing Manipulation at Stroke-Level
- 采用三级分层自回归流程,逐笔生成草图。
- 可在生成过程中动态修改笔画嵌入,实现灵活操控。
- 适合需要交互式草图编辑的研究与应用。
生成符合特定模式的草图,即对草图进行可控编辑,是当前热门任务。现有方法通过编辑笔画嵌入值来控制草图特征,但必须在生成前一次性输入所有条件,无法在绘制过程中进行调整。为实现更灵活的笔画级草图操作,本文提出一种分层自回归草图生成过程。该方法不一次性生成完整草图,而是将每笔草图生成分为三个阶段:1)预测代表将要绘制笔画的嵌入向量;2)将预测的笔画锚定在画布上;3)将嵌入向量转换为一系列绘图动作以形成完整草图。整个过程采用自回归方式,综合考虑已生成的笔画及其位置,以指导当前笔画的生成。由于暴露了可编辑的笔画嵌入,用户可在生成任意阶段动态调整笔画内容,实现灵活的草图操控。
原文摘要 · Abstract (English)
Generating sketches with specific patterns as expected, i.e., manipulating sketches in a controllable way, is a popular task. Recent studies control sketch features at stroke-level by editing values of stroke embeddings as conditions. However, in order to provide generator a global view about what a sketch is going to be drawn, all these edited conditions should be collected and fed into generator simultaneously before generation starts, i.e., no further manipulation is allowed during sketch generating process. In order to realize sketch drawing manipulation more flexibly, we propose a hierarchical auto-regressive sketch generating process. Instead of generating an entire sketch at once, each stroke in a sketch is generated in a three-staged hierarchy: 1) predicting a stroke embedding to represent which stroke is going to be drawn, and 2) anchoring the predicted stroke on the canvas, and 3) translating the embedding to a sequence of drawing actions to form the full sketch. Moreover, the stroke prediction, anchoring and translation are proceeded auto-regressively, i.e., both the recently generated strokes and their positions are considered to predict the current one, guiding model to produce an appropriate stroke at a suitable position to benefit the full sketch generation. It is flexible to manipulate stroke-level sketch drawing at any time during generation by adjusting the exposed editable stroke embeddings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。