根据图像不同区域需求动态调整去噪步数,提升超分辨率效率与质量。
AdaDiffSR: Adaptive Region-aware Dynamic Acceleration Diffusion Model for Real-World Image Super-Resolution
- 按区域感知信息增益动态选择去噪步数,避免无效计算。
- 在真实图像数据集上实现与顶尖方法相当的清晰度,推理时间更短。
- 适合需要高效高保真图像重建的应用场景。
扩散模型在单图超分辨率等图像到图像转换任务中表现优异,但通常依赖大量计算资源和长推理时间。现有方法对所有图像区域采用统一迭代修复,忽视了不同区域重建所需步数差异。本文发现,传统方法会浪费资源去重建不可见细节。为此提出AdaDiffSR,一种基于扩散模型的超分辨率框架,引入动态步数采样策略(DTSS)。通过多指标潜在熵模块(MMLE)实时感知去噪过程中的空间信息增益,动态决定每一步的采样位置;同时采用渐进特征注入模块(PFJ),根据当前信息增益动态融合原始图像特征,提升重建图像的真实感与保真度。实验表明,该方法在合成与真实世界数据集上均达到当前先进水平,同时显著降低计算开销与推理时间。
原文摘要 · Abstract (English)
Diffusion models (DMs) have shown promising results on single-image super-resolution and other image-to-image translation tasks. Benefiting from more computational resources and longer inference times, they are able to yield more realistic images. Existing DMs-based super-resolution methods try to achieve an overall average recovery over all regions via iterative refinement, ignoring the consideration that different input image regions require different timesteps to reconstruct. In this work, we notice that previous DMs-based super-resolution methods suffer from wasting computational resources to reconstruct invisible details. To further improve the utilization of computational resources, we propose AdaDiffSR, a DMs-based SR pipeline with dynamic timesteps sampling strategy (DTSS). Specifically, by introducing the multi-metrics latent entropy module (MMLE), we can achieve dynamic perception of the latent spatial information gain during the denoising process, thereby guiding the dynamic selection of the timesteps. In addition, we adopt a progressive feature injection module (PFJ), which dynamically injects the original image features into the denoising process based on the current information gain, so as to generate images with both fidelity and realism. Experiments show that our AdaDiffSR achieves comparable performance over current state-of-the-art DMs-based SR methods while consuming less computational resources and inference time on both synthetic and real-world datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。