arXiv:2602.15819cs.CV2026-02被引 1

用视频模型生成有顺序的高质量草图,让创作过程更自然。

VideoSketcher: Sequential Sketch Generation Using Video Model Priors

  • 结合语言模型规划步骤、视频扩散模型生成画面,分两阶段训练。
  • 仅用7个手绘样本就能学习风格,生成符合指定顺序的多样草图。
  • 适合艺术创作、设计探索,支持笔刷风格控制和持续生成。

草图绘制本质上是连续进行的:笔触逐步添加以探索和精炼创意。然而,大多数生成方法将草图视为静态图像,忽略了创作过程中的时间性。建模这一序列结构仍具挑战:先前方法要么依赖大规模但多样性有限的人类绘制数据集,要么使用大语言模型(LLM)生成作画指令,常牺牲视觉质量。我们提出VideoSketcher,通过将预训练文本到视频扩散模型适配于草图形成的稀疏连续特性,生成高质量的草图生成过程。核心洞察在于:LLM作为语义规划器,将概念分解为分步指令;视频扩散模型则充当强大“渲染器”,将其转化为时序连贯的草图序列。我们引入两阶段微调策略,分离时间结构与视觉外观:笔触顺序从合成形状组合中学习,风格则通过最少7个手绘样本蒸馏获得。尽管监督极少,该方法仍能生成忠实遵循指定绘制顺序的多样化高质量草图。框架可自然扩展至笔刷风格控制与自回归生成,支持艺术应用。

原文摘要 · Abstract (English)

Sketching is inherently sequential: strokes are drawn progressively to explore and refine ideas. Yet most generative approaches treat sketches as static images, ignoring the temporal process underlying creative exploration. Modeling this sequential structure remains challenging: prior methods either rely on large-scale human-drawn datasets with limited diversity, or use large language models (LLMs) to produce drawing instructions, often at the cost of visual fidelity. We present VideoSketcher, a method for generating high-quality sketching processes by adapting pretrained text-to-video diffusion models to the sparse, continuous nature of sketch formation. Our key insight is that LLMs and video diffusion models offer complementary strengths: LLMs act as semantic planners that decompose concepts into step-by-step instructions, while video diffusion models serve as powerful "renderers" that translate them into temporally coherent sketch sequences. We introduce a two-stage fine-tuning strategy that decouples temporal structure from visual appearance: stroke ordering is learned from synthetic shape compositions, while style is distilled from as few as seven hand-drawn examples. Despite minimal supervision, our method can generate diverse, high-quality sequential sketches that faithfully follow specified drawing orders. Our framework naturally extends to brush style control and autoregressive generation, supporting artistic applications.

草图生成视频扩散序列建模艺术生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。