arXiv:2606.01048cs.CV2026-06被引 3

提出分阶段去噪扩散模型,提升图像到图像翻译的数据效率与统一性。

Decoupled Residual Denoising Diffusion Models for Unified and Data Efficient Image-to-Image Translation

论文配图:Decoupled Residual Denoising Diffusion Models for Unified and Data Efficient Image-to-Image Translation
图 1 · 摘自论文原文
  • 将去噪过程拆分为噪声扩散与残差去噪两阶段,分别实现域对齐和语义映射。
  • 仅用未配对目标域图像训练噪声阶段,大幅降低对配对数据依赖。
  • 适用于多种图像翻译任务,尤其适合小样本或无配对数据场景。

我们提出解耦残差去噪扩散模型(DRDD),用于统一且高效的数据图像到图像(I2I)翻译。尽管扩散模型在生成质量和多样性上已取得进展,但我们发现其尚未被充分探索的特性:注入高斯噪声不仅能实现流形升维(即脱离低维流形),还能通过隐式对齐跨域特征分布来促进域和谐化,这对统一I2I翻译尤为有利。然而,现有模型在单一耦合过程中同时移除噪声与残差,过早破坏了这一和谐效应。为此,DRDD将扩散过程解耦为两个独立阶段:(1) 随机噪声扩散,用于域和谐化与流形升维;(2) 确定性残差扩散,在固定噪声域内学习核心语义映射。该设计全程保留域和谐化与流形升维效果,显著简化了跨任务、跨域的统一映射学习。值得注意的是,噪声扩散阶段仅需大量未配对的目标域图像进行训练,极大提升了数据效率。理论与实证分析表明,DRDD广泛兼容主流扩散模型,并在有限配对数据下仍能持续提供鲁棒、统一的I2I翻译性能。代码已开源:https://github.com/HKU-HealthAI/DRDD。

原文摘要 · Abstract (English)

We propose Decoupled Residual Denoising Diffusion models (DRDD) for unified and data-efficient image-to-image (I2I) translation. While diffusion models have advanced I2I translation in terms of quality and diversity, we uncover a previously under-explored property in diffusion models. Crucially, beyond its conventional role of manifold lifting (i.e., moving data off low-dimensional manifolds), injecting Gaussian noise facilitates domain harmonization by implicitly aligning feature distributions across domains, a property particularly advantageous for unified I2I translation. However, existing diffusion models prematurely erode this harmonization effect, as noise and residuals are simultaneously removed in a single coupled diffusion process. To address this, DRDD decouples the diffusion process into two sequential and independent diffusion stages: (1) a stochastic noise diffusion for domain harmonization and manifold lifting, and (2) a deterministic residual diffusion that learns the core semantic mapping entirely within the fixed-noise domain. This decoupling preserves harmonization and manifold lifting effects throughout the transformation, substantially simplifying the learning of unified mappings across diverse tasks and domains. Notably, the noise diffusion stage is trained exclusively on abundant, unpaired target-domain images, greatly improving data efficiency. Comprehensive theoretical and empirical analysis demonstrates that DRDD is broadly compatible with mainstream diffusion models and consistently delivers robust, unified I2I translation, even under limited paired data. Our code is available at https://github.com/HKU-HealthAI/DRDD.

图像翻译扩散模型数据效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。