让图像风格迁移可连续调节,保持内容不变且过渡自然。
Staying True to the Origin: Continuous Image Stylization with Smooth Transitions

- 分两阶段训练,用样条插值实现风格强度的平滑控制。
- 仅用少数离散强度训练,推理时可精确调节任意强度。
- 适合需要精细调整风格强度的研究者与创作者。
生成模型在文本和图像条件编辑方面取得显著进展,但如何在参考另一图像的风格模式的同时保持原图内容却仍具挑战,常导致风格化结果失控。本文从连续控制视角出发,旨在使基于Diffusion Transformer(DiT)的多参考编辑模型实现:(1) 准确保留内容图像的语义结构,(2) 实现强烈的风格效果,(3) 在风格间实现平滑过渡。为此,提出一种简单而有效的两阶段训练策略,结合风格强度感知的样条公式。第一阶段训练模型生成强风格化输出并尽可能保留内容语义;第二阶段冻结基础模型,学习一组锚点投影器,将不同风格强度映射至模型参数空间。推理时,在低秩空间中进行风格强度感知的样条插值,从而实现连续控制,即使模型仅在少数离散强度水平下训练。大量实验表明,该方法可在现代DiT模型上实现对风格强度的精准、连续操控,并生成高保真结果。
原文摘要 · Abstract (English)
Recent advances in generative models have achieved remarkable performance in text- and image-conditioned editing. However, preserving the content of a given image while referencing style patterns from another remains challenging, often leading to uncontrollable stylization results. In this paper, we approach image stylization from the perspective of continuous control, aiming to enable modern Diffusion Transformer (DiT)-based multi-reference editing models to (1) faithfully preserve the semantic structure of the content image, (2) render strong stylization effects, and (3) smoothly transition between the two. To this end, we propose a simple yet effective two-stage training strategy along with a style-strength-aware spline formulation. Specifically, in the first stage, the model is trained to produce strongly stylized outputs while preserving the content semantics as much as possible. In the second stage, with the base model frozen, we learn a set of anchor projectors that map various stylization strengths into the model parameter space. During inference, by performing style-strength-aware spline interpolation in a low-rank space, our method enables continuous control over stylization strength, even though the model is trained with only a few discrete strength levels. Extensive experiments demonstrate that our method supports precise and continuous manipulation of stylization strength while generating high-fidelity results with modern DiT models. Project page: https://reychiaro.github.io/StyleController.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。