arXiv:2604.01715cs.CV2026-04被引 4

提出SteerFlow框架,实现高保真图像编辑,避免失真与漂移。

SteerFlow: Steering Rectified Flows for Faithful Inversion-Based Image Editing

  • 用隐式轨迹修正与速度一致性提升反演精度
  • 通过自适应插值和掩码保持背景细节,编辑更自然
  • 适用于多轮编辑,不积累误差,适合高质量图像修改

基于流的生成模型近年实现了无需训练、文本引导的图像编辑:通过将图像反演到潜在噪声空间,并在新条件引导下重新生成。然而现有方法难以保证源图保真度:高阶求解器增加模型推理次数,截断反演限制可编辑性,特征注入方法缺乏架构通用性。为此,我们提出SteerFlow,一种无需依赖模型的编辑框架,具备强理论保障的源图保真性。前向过程引入近似固定点求解器,通过强制连续时间步间速度一致,隐式拉直前向轨迹,获得高保真反演潜在表示。后向过程引入轨迹插值,自适应融合目标编辑与源重建速度,使编辑轨迹锚定于原始图像。为进一步提升背景保留效果,引入自适应掩码机制,结合概念分割与源-目标速度差,对编辑信号进行空间约束。在FLUX.1-dev和Stable Diffusion 3.5 Medium上的实验表明,SteerFlow持续优于现有方法。最后证明,SteerFlow可自然扩展至复杂多轮编辑,且不产生漂移。

原文摘要 · Abstract (English)

Recent advances in flow-based generative models have enabled training-free, text-guided image editing by inverting an image into its latent noise and regenerating it under a new target conditional guidance. However, existing methods struggle to preserve source fidelity: higher-order solvers incur additional model inferences, truncated inversion constrains editability, and feature injection methods lack architectural transferability. To address these limitations, we propose SteerFlow, a model-agnostic editing framework with strong theoretical guarantees on source fidelity. In the forward process, we introduce an Amortized Fixed-Point Solver that implicitly straightens the forward trajectory by enforcing velocity consistency across consecutive timesteps, yielding a high-fidelity inverted latent. In the backward process, we introduce Trajectory Interpolation, which adaptively blends target-editing and source-reconstruction velocities to keep the editing trajectory anchored to the source. To further improve background preservation, we introduce an Adaptive Masking mechanism that spatially constrains the editing signal with concept-guided segmentation and source-target velocity differences. Extensive experiments on FLUX.1-dev and Stable Diffusion 3.5 Medium demonstrate that SteerFlow consistently achieves better editing quality than existing methods. Finally, we show that SteerFlow extends naturally to a complex multi-turn editing paradigm without accumulating drift.

图像编辑流模型保真度多轮编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。