用分形特征增强扩散模型,让超分辨率图像细节更真实。
MFSR: Multi-fractal Feature for Super-resolution Reconstruction with Fine Details Recovery
- 用卷积软分配近似低分辨率图的分形特征,捕捉多尺度自相似性。
- 在多个面部与自然图像数据集上,生成图像质量显著提升。
- 适合需要高保真纹理恢复的图像重建任务,如人脸修复。
图像超分辨率处理中,复杂局部信息的处理对生成质量影响显著。分形特征能捕捉图像微观与宏观纹理结构的丰富细节。为此,我们提出一种基于扩散模型的超分辨率方法——MFSR,将低分辨率图像的分形特征作为去噪过程中的强化条件,以确保纹理信息的精确恢复。MFSR采用卷积进行软分配,近似低分辨率图像的分形特征与密度特征图,通过该机制层次化描述图像空间布局,编码不同尺度下的自相似特性。针对不同类型特征采用差异化处理策略,丰富模型获取的信息。此外,在去噪U-Net中引入子去噪器,降低上采样过程中特征图的噪声,从而提升生成图像质量。在多个面部与自然图像数据集上的实验表明,MFSR可生成更高品质图像。
原文摘要 · Abstract (English)
In the process of performing image super-resolution processing, the processing of complex localized information can have a significant impact on the quality of the image generated. Fractal features can capture the rich details of both micro and macro texture structures in an image. Therefore, we propose a diffusion model-based super-resolution method incorporating fractal features of low-resolution images, named MFSR. MFSR leverages these fractal features as reinforcement conditions in the denoising process of the diffusion model to ensure accurate recovery of texture information. MFSR employs convolution as a soft assignment to approximate the fractal features of low-resolution images. This approach is also used to approximate the density feature maps of these images. By using soft assignment, the spatial layout of the image is described hierarchically, encoding the self-similarity properties of the image at different scales. Different processing methods are applied to various types of features to enrich the information acquired by the model. In addition, a sub-denoiser is integrated in the denoising U-Net to reduce the noise in the feature maps during the up-sampling process in order to improve the quality of the generated images. Experiments conducted on various face and natural image datasets demonstrate that MFSR can generate higher quality images.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。