提出动态条件双扩散桥,解决多任务病态问题的图像处理难题
DCDB: Dynamic Conditional Dual Diffusion Bridge for Ill-posed Multi-Tasks
- 分离扩散与条件生成过程,避免依赖标注数据
- 用同噪声调度生成动态条件,提升学习效率
- 在去雾和可见光红外融合中性能领先,适合数据少的任务
条件扩散模型在图像处理领域取得显著进展,但其构建数据分布路径的特性导致难以挖掘多任务场景中的内在关联,尤其在缺乏训练数据的病态任务中更为严重。传统静态条件控制难以适应多任务动态变化的特点。为此,我们提出一种动态条件双扩散桥训练范式,构建适用于病态多任务的通用框架。首先,解耦扩散与条件生成过程,避免扩散模型在病态任务中对监督数据的依赖;其次,利用相同噪声调度生成动态条件,逐步调整其统计特性,自然嵌入时间相关信息,降低网络学习难度。我们分析了单步去噪过程中不同条件形式下的学习目标,并对比网络注意力权重的变化,验证了动态条件的优势。以去雾和可见光-红外融合为典型病态多任务场景,在多个公开数据集上实现多项指标最优。代码已公开:https://anonymous.4open.science/r/DCDB-D3C2。
原文摘要 · Abstract (English)
Conditional diffusion models have made impressive progress in the field of image processing, but the characteristics of constructing data distribution pathways make it difficult to exploit the intrinsic correlation between tasks in multi-task scenarios, which is even worse in ill-posed tasks with a lack of training data. In addition, traditional static condition control makes it difficult for networks to learn in multi-task scenarios with its dynamically evolving characteristics. To address these challenges, we propose a dynamic conditional double diffusion bridge training paradigm to build a general framework for ill-posed multi-tasks. Firstly, this paradigm decouples the diffusion and condition generation processes, avoiding the dependence of the diffusion model on supervised data in ill-posed tasks. Secondly, generated by the same noise schedule, dynamic conditions are used to gradually adjust their statistical characteristics, naturally embed time-related information, and reduce the difficulty of network learning. We analyze the learning objectives of the network under different conditional forms in the single-step denoising process and compare the changes in its attention weights in the network, demonstrating the superiority of our dynamic conditions. Taking dehazing and visible-infrared fusion as typical ill-posed multi-task scenarios, we achieve the best performance in multiple indicators on public datasets. The code has been publicly released at: https://anonymous.4open.science/r/DCDB-D3C2.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。