用新方法让图像风格迁移更自然,同时保留原图内容。
Balanced Image Stylization with Style Matching Score
- 将风格迁移转化为风格分布匹配问题,提升控制精度。
- 在多个数据集上优于现有方法,实现风格与内容的更好平衡。
- 适合需要快速、高质量风格迁移的应用场景。
我们提出风格匹配得分(SMS),一种基于扩散模型的图像风格化优化方法。传统方法难以兼顾风格迁移效果与内容保留。不同于以往工作,本方法将图像风格化重构为风格分布匹配问题:通过设计的得分函数,从现成的风格相关LoRA中估计目标风格分布。为自适应保留内容信息,提出渐进频谱正则化,在频率域中由低频布局逐步引导至高频细节。此外,设计语义感知梯度精炼技术,利用扩散模型的语义先验生成相关性图,选择性地对语义重要区域进行风格化。所提优化框架将风格化从像素空间拓展至参数空间,可直接应用于轻量级前馈生成器,实现高效单步风格化。大量实验验证,SMS有效平衡风格对齐与内容保留,优于当前最优方法。
原文摘要 · Abstract (English)
We present Style Matching Score (SMS), a novel optimization method for image stylization with diffusion models. Balancing effective style transfer with content preservation is a long-standing challenge. Unlike existing efforts, our method reframes image stylization as a style distribution matching problem. The target style distribution is estimated from off-the-shelf style-dependent LoRAs via carefully designed score functions. To preserve content information adaptively, we propose Progressive Spectrum Regularization, which operates in the frequency domain to guide stylization progressively from low-frequency layouts to high-frequency details. In addition, we devise a Semantic-Aware Gradient Refinement technique that leverages relevance maps derived from diffusion semantic priors to selectively stylize semantically important regions. The proposed optimization formulation extends stylization from pixel space to parameter space, readily applicable to lightweight feedforward generators for efficient one-step stylization. SMS effectively balances style alignment and content preservation, outperforming state-of-the-art approaches, verified by extensive experiments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。