用可微分笔触重建技术,还原绘画的自然创作过程。
Birth of a Painting: Differentiable Brushstroke Reconstruction
- 通过可微分渲染优化贝塞尔笔触,实现精准控制
- 融合风格化纹理与可微模糊,生成平滑渐变效果
- 适合数字艺术创作与风格迁移研究者使用
绘画是一种独特的视觉叙事形式,创作过程与最终作品同样重要。尽管生成模型在图像合成方面取得进展,但现有方法多聚焦于最终图像生成或局部过程模拟,缺乏显式的笔触结构,难以生成流畅真实的明暗过渡。本文提出一种可微分笔触重建框架,统一了绘画、风格化着色与揉擦处理,忠实还原人类绘画-揉擦的循环过程。给定输入图像,首先通过并行可微分渲染器优化单色与双色贝塞尔笔触,随后由风格生成模块在几何约束下合成多样绘画风格的纹理。我们进一步引入可微分揉擦算子,实现自然的颜色混合与明暗过渡。结合粗到精优化策略,在几何与语义引导下联合优化笔触形状、颜色与纹理。在油画、水彩、墨画及数字绘画上的大量实验表明,该方法能生成真实且富有表现力的笔触重构,实现平滑色调过渡与丰富的风格化外观,为表达性数字绘画创作提供统一模型。
原文摘要 · Abstract (English)
Painting embodies a unique form of visual storytelling, where the creation process is as significant as the final artwork. Although recent advances in generative models have enabled visually compelling painting synthesis, most existing methods focus solely on final image generation or patch-based process simulation, lacking explicit stroke structure and failing to produce smooth, realistic shading. In this work, we present a differentiable stroke reconstruction framework that unifies painting, stylized texturing, and smudging to faithfully reproduce the human painting-smudging loop. Given an input image, our framework first optimizes single- and dual-color Bezier strokes through a parallel differentiable paint renderer, followed by a style generation module that synthesizes geometry-conditioned textures across diverse painting styles. We further introduce a differentiable smudge operator to enable natural color blending and shading. Coupled with a coarse-to-fine optimization strategy, our method jointly optimizes stroke geometry, color, and texture under geometric and semantic guidance. Extensive experiments on oil, watercolor, ink, and digital paintings demonstrate that our approach produces realistic and expressive stroke reconstructions, smooth tonal transitions, and richly stylized appearances, offering a unified model for expressive digital painting creation. See our project page for more demos: https://yingjiang96.github.io/DiffPaintWebsite/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。