arXiv:2508.10779cs.CVcs.AI2025-08被引 1

提出首个面向超高清地标图像的生成式参考超分方法。

Ultra-High-Definition Reference-Based Landmark Image Super-Resolution with Generative Diffusion Prior

  • 设计显式特征匹配机制,提升低清图与参考高清图对齐精度。
  • 在Landmark-4K数据集上实现4K级超分,细节还原更真实。
  • 适合城市景观、旅游图像等超高清重建场景研究者使用。

基于参考的图像超分辨率(RefSR)通过额外的高分辨率参考图像,利用其语义和纹理信息恢复低分辨率图像。现有基于扩散模型的RefSR方法多依赖ControlNet,难以有效对齐低分辨率图像与参考高分辨率图像之间的信息。此外,当前RefSR数据集分辨率有限、图像质量不佳,导致参考图像缺乏足够细粒度细节以支持高质量重建。为此,我们提出TriFlowSR框架,显式实现低分辨率图像与参考高分辨率图像间的模式匹配。同时,构建了首个面向超高清地标场景的RefSR数据集Landmark-4K。针对真实世界退化下的超高清场景,我们在TriFlowSR中设计了参考图像匹配策略,有效对齐两者。实验表明,该方法相比以往方法更充分地利用了参考图像的语义与纹理信息。据我们所知,这是首个在真实退化条件下,面向超高清地标场景的扩散模型参考超分方案。代码与模型将公开于https://github.com/nkicsl/TriFlowSR。

原文摘要 · Abstract (English)

Reference-based Image Super-Resolution (RefSR) aims to restore a low-resolution (LR) image by utilizing the semantic and texture information from an additional reference high-resolution (reference HR) image. Existing diffusion-based RefSR methods are typically built upon ControlNet, which struggles to effectively align the information between the LR image and the reference HR image. Moreover, current RefSR datasets suffer from limited resolution and poor image quality, resulting in the reference images lacking sufficient fine-grained details to support high-quality restoration. To overcome the limitations above, we propose TriFlowSR, a novel framework that explicitly achieves pattern matching between the LR image and the reference HR image. Meanwhile, we introduce Landmark-4K, the first RefSR dataset for Ultra-High-Definition (UHD) landmark scenarios. Considering the UHD scenarios with real-world degradation, in TriFlowSR, we design a Reference Matching Strategy to effectively match the LR image with the reference HR image. Experimental results show that our approach can better utilize the semantic and texture information of the reference HR image compared to previous methods. To the best of our knowledge, we propose the first diffusion-based RefSR pipeline for ultra-high definition landmark scenarios under real-world degradation. Our code and model will be available at https://github.com/nkicsl/TriFlowSR.

图像超分扩散模型参考图像超高清

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。