arXiv:2510.25970cs.CV2025-10NeurIPS被引 15

无需反演的文本到图像编辑,通过分解提示词提升编辑精度与多样性。

SplitFlow: Flow Decomposition for Inversion-Free Text-to-Image Editing

  • 将目标提示词拆解为多个子提示,分别生成独立流再聚合。
  • 在无反演条件下实现更高语义保真度与属性解耦效果。
  • 适合追求高精度零样本图像编辑的研究者和开发者。

修正流模型因其稳定的采样轨迹和高质量输出,已成为图像生成的主流方法。然而,在图像编辑任务中,其面临两大挑战:真实图像反演至潜在空间不准确,以及编辑过程中梯度纠缠导致输出与目标提示不符。现有方法虽尝试通过基于常微分方程(ODE)的直接映射避免反演,但仍存在编辑质量不足的问题。本文提出一种基于无反演公式的流分解与聚合框架。具体而言,我们将目标提示词语义分解为多个子提示,分别为每个子提示计算独立的流,并聚合形成统一的编辑轨迹。实验表明,这种分解能增强目标空间的多样性,但需保持对完整提示的一致引导。为此,我们设计了一种投影与软聚合机制,受多任务学习中梯度冲突解决启发,自适应加权子目标速度场,抑制语义冗余、突出差异方向,从而在保留多样性的同时保证输出一致性。结果表明,该方法在零样本编辑任务中优于现有方法,在语义保真度和属性解耦方面表现更优。代码已开源:https://github.com/Harvard-AI-and-Robotics-Lab/SplitFlow。

原文摘要 · Abstract (English)

Rectified flow models have become a de facto standard in image generation due to their stable sampling trajectories and high-fidelity outputs. Despite their strong generative capabilities, they face critical limitations in image editing tasks: inaccurate inversion processes for mapping real images back into the latent space, and gradient entanglement issues during editing often result in outputs that do not faithfully reflect the target prompt. Recent efforts have attempted to directly map source and target distributions via ODE-based approaches without inversion; however,these methods still yield suboptimal editing quality. In this work, we propose a flow decomposition-and-aggregation framework built upon an inversion-free formulation to address these limitations. Specifically, we semantically decompose the target prompt into multiple sub-prompts, compute an independent flow for each, and aggregate them to form a unified editing trajectory. While we empirically observe that decomposing the original flow enhances diversity in the target space, generating semantically aligned outputs still requires consistent guidance toward the full target prompt. To this end, we design a projection and soft-aggregation mechanism for flow, inspired by gradient conflict resolution in multi-task learning. This approach adaptively weights the sub-target velocity fields, suppressing semantic redundancy while emphasizing distinct directions, thereby preserving both diversity and consistency in the final edited output. Experimental results demonstrate that our method outperforms existing zero-shot editing approaches in terms of semantic fidelity and attribute disentanglement. The code is available at https://github.com/Harvard-AI-and-Robotics-Lab/SplitFlow.

图像编辑扩散模型流模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。