用可学习线性外推提升少步扩散逆问题算法性能
Improving Diffusion-based Inverse Algorithms under Few-Step Constraint via Learnable Linear Extrapolation
- 发现逆问题扩散算法有线性组合结构,提出统一形式
- 提出LLE方法,在少步条件下显著提升多类算法性能
- 轻量级设计适合各类扩散逆问题,尤其适合算力受限场景
基于扩散的逆问题算法在多种任务中表现优异,但依赖大量去噪步骤导致计算成本高。尽管快速扩散常微分方程(ODE)求解器能有效加速采样,但在逆问题中的应用受限于算法形式异质性及广泛使用的近似与启发式策略,常引入显著误差。本文分析逆问题的ODE求解器,揭示其近似具有线性组合结构,据此提出一个统一的规范形式,支持更通用的求解器设计。受线性子空间搜索启发,提出可学习线性外推(LLE),通过优化组合系数,利用历史估计修正当前预测,降低解析求解器对初始条件的敏感性。大量实验表明,该方法在多个算法和任务中均实现稳定提升,验证了其在少步约束下提升效率与性能的潜力。代码已开源。
原文摘要 · Abstract (English)
Diffusion-based inverse algorithms have shown remarkable performance across various inverse problems, yet their reliance on numerous denoising steps incurs high computational costs. While recent developments of fast diffusion ODE solvers offer effective acceleration for diffusion sampling without observations, their application in inverse problems remains limited due to the heterogeneous formulations of inverse algorithms and their prevalent use of approximations and heuristics, which often introduce significant errors that undermine the reliability of analytical solvers. In this work, we begin with an analysis of ODE solvers for inverse problems that reveals a linear combination structure of approximations for the inverse trajectory. Building on this insight, we propose a canonical form that unifies a broad class of diffusion-based inverse algorithms and facilitates the design of more generalizable solvers. Inspired by the linear subspace search strategy, we propose Learnable Linear Extrapolation (LLE), a lightweight approach that universally enhances the performance of any diffusion-based inverse algorithm conforming to our canonical form. LLE optimizes the combination coefficients to refine current predictions using previous estimates, alleviating the sensitivity of analytical solvers for inverse algorithms. Extensive experiments demonstrate consistent improvements of the proposed LLE method across multiple algorithms and tasks, indicating its potential for more efficient solutions and boosted performance of diffusion-based inverse algorithms with limited steps. Codes for reproducing our experiments are available at https://github.com/weigerzan/LLE_inverse_problem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。