arXiv:2608.29997cs.CV2026-08中稿 · ECCV

解决图像生成中的时空错位问题,提升编辑对齐与结构保真度。

Discrete Diffusion Bridges for Spatiotemporally Aligned Image Translation and Generation

论文配图:Discrete Diffusion Bridges for Spatiotemporally Aligned Image Translation and Generation
图 1 · 摘自论文原文
  • 构建直接跨域轨迹,用混合吸收机制保留源图结构先验。
  • 设计信息引导的噪声调度,优先破坏高信息区域以增强上下文鲁棒性。
  • 支持文本引导与纯结构转换,低采样步数下仍生成高质量图像。

我们提出离散扩散桥(DDB),一种新框架,用于解决标准离散扩散在图像翻译与生成中的固有时空错位问题。通过随机调度将数据腐蚀至纯掩码状态,传统前向过程导致双重错位:空间上,纯掩码终点完全丢弃源图像的丰富结构先验;时间上,随机掩码顺序与推理时“由易到难”的解码机制相矛盾。为解决此问题,DDB构建了直接高效的跨域轨迹。空间上,引入混合吸收机制,将吸收态重新定义为掩码与源标记的随机混合,有效将源先验作为空间锚点注入潜在空间。时间上,设计信息引导的噪声调度,量化语义变化以优先在早期步骤腐蚀高信息区域,确保模型利用不变区域的稳健上下文解决困难语义变化。大量实验验证了该框架在多样化生成范式中的通用性与鲁棒性。DDB在文本引导语义操作和纯结构图像翻译中均能有效平衡编辑对齐与结构保真度,同时天然增强文本到图像生成,并在极低采样步数下保证高质量解码。代码与模型见 https://github.com/HKU-HealthAI/DDB。

原文摘要 · Abstract (English)

We propose Discrete Diffusion Bridges (DDB), a novel framework designed to resolve the fundamental spatiotemporal misalignment of standard discrete diffusion in image translation and generation. By corrupting data into a pure mask state via a random schedule, the conventional forward process induces a twofold misalignment: spatially, this pure-mask destination entirely discards the rich structural priors of the source image; temporally, the random masking order inherently contradicts the ``easy-first, hard-last'' decoding mechanism used during inference. To address this, DDB constructs a direct and efficient trajectory between domains. Spatially, we introduce a hybrid absorption mechanism that redefines the absorbing state to a stochastic mixture of mask and source tokens, effectively injecting source prior as spatial anchors into the latent space. Temporally, we design an information-guided noise schedule that quantifies semantic variation to prioritize the corruption of high-information regions at earlier timesteps. This ensures the model learns to resolve difficult semantic changes using robust context from invariant regions. Extensive experiments validate the versatility and robustness of our framework across diverse generative paradigms. DDB effectively balances edit alignment with structural fidelity across both text-guided semantic manipulation and pure structural image translation, while inherently complementing text-to-image generation and guaranteeing robust high-quality decoding under extremely low sampling steps. Code and models are available at \href{https://github.com/HKU-HealthAI/DDB}{https://github.com/HKU-HealthAI/DDB}.

图像生成扩散模型结构保真

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。