arXiv:2605.21381cs.CVcs.LG2026-05

将生成与回归解耦,实现图像修复的灵活控制与高效推理。

Disentangling Generation and Regression in Stochastic Interpolants for Controllable Image Restoration

论文配图:Disentangling Generation and Regression in Stochastic Interpolants for Controllable Image Restoration
图 1 · 摘自论文原文
  • 分离随机插值中的生成与回归过程,实现统一建模。
  • 单次推理即可完成修复,支持少步数高质量输出。
  • 适合需要调节清晰度与真实感平衡的修复场景。

近期图像修复(IR)进展主要由生成模型(如扩散模型和流匹配)驱动,其在合成逼真纹理方面表现优异,但存在多步推理慢、像素级保真度下降的问题。相反,传统回归方法虽具单步高效与高像素重建精度优势,却难以生成自然细节。为此,本文提出DiSI框架,将底层随机插值过程解耦为独立的生成与回归组件。该设计使DiSI具备卓越灵活性,可连续且可控地在纯回归与完全生成之间切换。技术上,我们实现了两种特定采样轨迹,并设计了统一采样器,支持任意轨迹上的高质量少步推理。此外,采用双分支U-Net风格的Transformer网络,通过专用分支增强条件引导,同时保障高吞吐。大量实验表明,DiSI在多种图像修复任务中均取得有竞争力的结果,且在单一模型内实现推理时对失真与感知质量权衡的灵活调控。

原文摘要 · Abstract (English)

Recent advances in Image Restoration (IR) have been largely driven by generative methods such as Diffusion Models and Flow Matching, which excel in synthesizing realistic textures while suffering from slow multi-step inference and compromised pixel fidelity. In contrast, classical regression-based IR methods excel precisely in these aspects, offering single-step efficiency and high pixel-level reconstruction fidelity. To bridge this gap, we propose DiSI, a unified framework that Disentangles the underlying Stochastic Interpolant process into independent generation and regression components. This decoupling endows DiSI with remarkable versatility, enabling a continuous and controllable transition from a pure regression process to a fully generative one. Technically, we instantiate this framework with two specific sampling trajectories, accompanied by a unified sampler for high-quality, few-step inference on arbitrary trajectories. Furthermore, we design a dual-branch U-Net style transformer network in pixel space, using a dedicated branch to enhance conditional guidance while ensuring high throughput. Extensive experiments demonstrate that DiSI efficiently achieves competitive results on various IR tasks, while uniquely offering the inference-time flexibility to control the distortion-perception trade-off within a single model.

图像修复扩散模型可控生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。