arXiv:2605.15816cs.GRcs.CV2026-05

用扩散模型实现可调节点数的图像点绘,速度快且支持端到端训练。

StippleDiffusion: Capacity-Constrained Stippling using Controlled Diffusion

论文配图:StippleDiffusion: Capacity-Constrained Stippling using Controlled Diffusion
图 1 · 摘自论文原文
  • 基于扩散模型与控制网络,结合密度图与高分辨率图像生成点阵。
  • 在Icons-50上性能媲美传统优化方法,点数变化不影响推理时间。
  • 支持任意目标密度和未训练点数,适合需要快速生成的场景。

点绘图案是由局部密度匹配目标图像的点集,传统方法依赖逐密度迭代优化,速度慢、不可导,且需对每张新图重新计算。现有学习方法仅能生成无条件点集,无法满足容量约束下的图像条件点绘。本文提出首个扩散模型采样器,可同时满足学习到的局部点分布先验和连续的、由图像定义的容量约束。该方法基于最优传输网格点集扩散基线,在控制网络分支上进行条件建模,输入目标密度图与高分辨率图像。两个设计使组合可行:训练与推理限定在去噪后期阶段,初始化为密度加权拒绝采样;标准零卷积注入被替换为带Sigmoid门控的一维投影,保留基础模型的蓝噪声结构。单个训练检查点可在推理时接受任意目标密度,泛化至训练未见的点数预算,并以几乎与输出点数无关的时间生成点绘。在Icons-50基准上,本方法在所有报告指标上达到与逐密度优化基线相当的性能,同时保持端到端可导。

原文摘要 · Abstract (English)

Stipple patterns, point sets whose local density tracks a target image, are traditionally produced by per-density iterative optimizers, which are slow, non-differentiable, and must be re-run from scratch for each new target. Learned alternatives have so far addressed only unconditional point generation; capacity-constrained, image-conditioned stippling has remained out of reach. We present the first diffusion-based sampler that simultaneously satisfies a learned local point-distribution prior and a continuous, image-defined capacity constraint at inference. The method is a ControlNet branch built on top of an optimal-transport-grid point-set diffusion baseline, conditioned on the target density map and a high-resolution image. Two design choices make the combination tractable: training and inference are restricted to the late-stage denoising regime, initialized from a density-weighted rejection sample, and the standard zero-convolution injection is replaced with a sigmoid-gated 1x1 projection that preserves the base model's blue-noise structure under hard density signals. A single trained checkpoint accepts arbitrary target densities at inference, generalizes to point budgets that were not seen during training, and produces stipples in time nearly independent of the output point count. On the Icons-50 benchmark, our learned sampler reaches parity with per-density-optimized baselines on every reported metric while remaining differentiable end-to-end.

点绘生成扩散模型图像生成控制网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。