用改进的数值求解器提升图像修复与编辑精度
Adams Bashforth Moulton Solver for Inversion and Editing in Rectified Flow
- 采用多步预测校正法降低微分方程求解误差
- 自适应步长调整使采样速度更快,精度更高
- 掩码引导特征注入实现局部编辑且保留未修改区域
修正流模型在图像和视频生成任务中表现优异,但现有数值求解器在快速采样与高精度之间存在权衡,限制了其在重建与编辑等下游任务中的应用。为此,本文提出引入亚当斯-巴什福斯-莫尔顿(ABM)预测-校正方法,以提升修正流模型中微分方程求解的精度。具体地,我们设计了ABM Solver,通过多步预测-校正机制减少局部截断误差,并采用自适应步长调整策略提高采样效率。此外,为有效保留未编辑区域并支持语义级修改,我们提出掩码引导特征注入模块,基于自相似性估计生成空间掩码,区分可编辑与需保留区域。在多个高分辨率图像数据集上的实验表明,ABM Solver 显著提升了逆向重构精度与编辑质量,优于现有求解器,且无需额外训练或优化。
原文摘要 · Abstract (English)
Rectified flow models have achieved remarkable performance in image and video generation tasks. However, existing numerical solvers face a trade-off between fast sampling and high accuracy solutions, limiting their effectiveness in downstream applications such as reconstruction and editing. To address this challenge, we propose leveraging the Adams Bashforth Moulton (ABM) predictor corrector method to enhance the accuracy of ODE solving in rectified flow models. Specifically, we introduce ABM Solver, which integrates a multi step predictor corrector approach to reduce local truncation errors and employs Adaptive Step Size Adjustment to improve sampling speed. Furthermore, to effectively preserve non edited regions while facilitating semantic modifications, we introduce a Mask Guided Feature Injection module. We estimate self-similarity to generate a spatial mask that differentiates preserved regions from those available for editing. Extensive experiments on multiple high resolution image datasets validate that ABM Solver significantly improves inversion precision and editing quality, outperforming existing solvers without requiring additional training or optimization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。