arXiv:2605.15682cs.CV2026-05被引 1

解决超分辨率图像生成中局部过生成问题,提升细节真实感。

DreamSR: Towards Ultra-High-Resolution Image Super-Resolution via a Receptive-Field Enhanced Diffusion Transformer

论文配图:DreamSR: Towards Ultra-High-Resolution Image Super-Resolution via a Receptive-Field Enhanced Diffusion Transformer
图 1 · 摘自论文原文
  • 双分支控制网络:局部用补丁提示,全局用整体提示,避免信息错配。
  • 在1024×1024图像上实现清晰纹理重建,显著减少伪影。
  • 适合需要高保真细节的图像修复与超分任务。

大规模预训练扩散模型因具备强大的文本引导生成先验,被广泛用于真实世界图像超分辨率。然而,采用补丁式推理策略时,现有基于扩散的超分方法常因低分辨率图像提供的全局提示与局部补丁不完整的语义信息不匹配,导致过生成现象。同时,由于网络设计与训练策略过度强调全局生成能力,局部细节纹理恢复效果不佳。为此,我们提出DreamSR,一种新超分模型,有效抑制局部过生成并提升细粒度纹理合成,实现视觉上忠实的高质量结果。具体地,我们设计双分支MM-ControlNet:ControlNet生成基于补丁级提示的局部文本特征,预训练DiT提供基于全局提示的全局文本特征,从而缓解过生成并保证补丁间语义一致性。此外,我们引入分阶段数据处理流程与感受野增强策略,强化模型对补丁信息的捕捉能力,有效恢复局部纹理。大量实验表明,DreamSR超越现有最优方法,生成高质量超分结果。代码与模型见https://github.com/jerrydong0219/DreamSR。

原文摘要 · Abstract (English)

Large-scale pre-trained diffusion models have been extensively adopted for real-world image Super-Resolution because of their powerful generative priors through textual guidance. However, when super-resolving high-resolution images with patch-wise inference strategy, most existing diffusion-based SR methods tend to suffer from over-generation, due to the misalignment between the global prompt from LR image and the incomplete semantic information of local patches during each inference step. On the other hand, most existing methods also failed to generate detailed texture in local patches due to the overemphasis on global generation capabilities in network designs and training strategies. To address this issue, we present DreamSR, a novel SR model that suppresses local over-generation and improves fine-detail synthesis, thereby achieving visually faithful results with ultra-high-quality details. Specifically, we propose a dual-branch MM-ControlNet, where the ControlNet generates local textual feature with patch-level prompts while the pre-trained DiT provides global textual feature with global prompts, thereby mitigating over-generation and ensuring semantic consistency across patches. We also design a comprehensive training strategy with stage-specific data processing pipelines and a Receptive-Field Enhancement strategy, enhancing the model's capability to capture patch information and effectively restore local textures. Extensive experiments demonstrate that DreamSR outperforms state-of-the-art methods, providing high-quality SR results. Code and model are available at https://github.com/jerrydong0219/DreamSR.

超分辨率扩散模型细节生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。