arXiv:2510.03821cs.CV2025-10

用对比学习引导扩散模型,实现无配对图像翻译的高效生成。

Contrastive-SDE: Guiding Stochastic Differential Equations with Contrastive Learning for Unpaired Image-to-Image Translation

  • 通过时间依赖对比学习,保留语义不变特征,剔除域特定信息。
  • 在三个任务上达到当前最优性能,且收敛速度更快。
  • 无需标签或分类器训练,适合资源受限场景使用。

无配对图像到图像翻译旨在未提供对应样本的情况下学习源域与目标域间的映射。基于分数的扩散模型通过随机微分方程(SDEs)逼近复杂数据分布,在生成高保真、多样化输出方面表现卓越,特别适用于无配对场景。同时,对比学习无需显式监督即可学习语义相似性,通过拉近语义相似样本的表示、推开不相似者,天然契合无配对翻译目标。其在特征层面选择性地强化语义一致性,使生成过程更可控。本文提出一种时变对比学习方法:以图像及其域不变特征作为正样本对,采用SimCLR进行训练,从而保留域不变特征并丢弃域特定特征。该学习到的对比模型用于指导预训练SDE进行图像翻译推理。我们在三个常见无配对图像翻译任务上与多个基线进行比较,采用四项指标评估。结果表明,Contrastive-SDE在多项指标上达到当前最优水平。此外,模型收敛显著更快,且无需标签监督或分类器训练,是一种更高效的替代方案。

原文摘要 · Abstract (English)

Unpaired image-to-image translation involves learning mappings between source domain and target domain in the absence of aligned or corresponding samples. Score based diffusion models have demonstrated state-of-the-art performance in generative tasks. Their ability to approximate complex data distributions through stochastic differential equations (SDEs) enables them to generate high-fidelity and diverse outputs, making them particularly well-suited for unpaired I2I settings. In parallel, contrastive learning provides a powerful framework for learning semantic similarities without the need for explicit supervision or paired data. By pulling together representations of semantically similar samples and pushing apart dissimilar ones, contrastive methods are inherently aligned with the objectives of unpaired translation. Its ability to selectively enforce semantic consistency at the feature level makes contrastive learning particularly effective for guiding generation in unpaired scenarios. In this work, we propose a time-dependent contrastive learning approach where a model is trained with SimCLR by considering an image and its domain invarient feature as a positive pair, enabling the preservation of domain-invariant features and the discarding of domain-specific ones. The learned contrastive model then guides the inference of a pretrained SDE for the I2I translation task. We empirically compare Contrastive-SDE with several baselines across three common unpaired I2I tasks, using four metrics for evaluation. Constrastive-SDE achieves comparable results to the state-of-the-art on several metrics. Furthermore, we observe that our model converges significantly faster and requires no label supervision or classifier training, making it a more efficient alternative for this task.

图像生成扩散模型对比学习无配对翻译

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。