无需反演的文本图像编辑新方法,提升生成质量与可控性。
Delta Rectified Flow Sampling for Text-to-Image Editing
- 基于修正流模型,显式建模源与目标速度场差异
- 引入时间相关偏移项,显著减少过平滑伪影
- 兼容现有框架,适合追求高质量编辑的开发者
我们提出一种名为Delta修正流采样(DRFS)的新方法,这是一种在修正流模型中无需反演、路径感知的文本到图像编辑框架。该方法为蒸馏类采样设计,显式建模源与目标速度场之间的差异,以缓解先前蒸馏采样中普遍存在的过平滑伪影。我们进一步引入一个时间依赖的偏移项,使噪声潜在表示更贴近目标轨迹,增强与目标分布的对齐。理论上证明,关闭该偏移项可恢复Delta去噪得分(DDS),从而连接基于得分的扩散优化与基于速度的修正流优化。此外,在修正流动力学下,线性偏移调度严格还原了无需反演的FlowEdit方法,形成优化与常微分方程编辑的统一视角。我们通过分析指导偏移项设计,实验结果表明,在广泛使用的PIE基准上,DRFS在编辑质量、保真度和可控性方面均表现优异,且无需修改架构。代码已开源:https://github.com/Harvard-AI-and-Robotics-Lab/DeltaRectifiedFlowSampling。
原文摘要 · Abstract (English)
We propose Delta Rectified Flow Sampling (DRFS), a novel inversion-free, path-aware editing framework within rectified flow models for text-to-image editing. DRFS is a distillation-based method that explicitly models the discrepancy between the source and target velocity fields in order to mitigate over-smoothing artifacts rampant in prior distillation sampling approaches. We further introduce a time-dependent shift term to push noisy latents closer to the target trajectory, enhancing the alignment with the target distribution. We theoretically demonstrate that disabling this shift recovers Delta Denoising Score (DDS), bridging score-based diffusion optimization and velocity-based rectified-flow optimization. Moreover, under rectified-flow dynamics, a linear shift schedule recovers the inversion-free method FlowEdit as a strict special case, yielding a unifying view of optimization and ODE editing. We conduct an analysis to guide the design of our shift term, and experimental results on the widely used PIE Benchmark indicate that DRFS achieves superior editing quality, fidelity, and controllability while requiring no architectural modifications. Code is available at https://github.com/Harvard-AI-and-Robotics-Lab/DeltaRectifiedFlowSampling.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。