用语义引导的轻量级网络提升图像超分辨率细节质量
Semantic-Guided Global-Local Collaborative Networks for Lightweight Image Super-Resolution
- 引入语义先验指导超分,融合全局与局部特征增强细节
- 在多个数据集上实现领先性能,计算量减少12.81G多加法
- 适合需要高精度图像的测量系统、嵌入式视觉设备应用
单图像超分辨率(SISR)在提升各类基于视觉的仪器与测量系统的准确性与可靠性方面起着关键作用。然而,视觉测量工具获取的图像常存在模糊和细节丢失等问题,影响测量精度。为此,本文提出一种语义引导的全局-局部协同网络(SGGLC-Net),利用预训练模型提取的语义先验信息引导超分过程。设计了语义引导模块,将语义先验无缝融入超分网络,有效提升细节重建能力;并提出全局-局部协同模块,包含三个全局与局部细节增强模块及混合注意力机制,以高效学习有用特征。大量实验表明,该方法在多个基准数据集上达到优异的PSNR与SSIM值,相比现有轻量级超分方法,多加法数减少12.81G,显著提升视觉测量系统的精度与效率。代码已开源。
原文摘要 · Abstract (English)
Single-Image Super-Resolution (SISR) plays a pivotal role in enhancing the accuracy and reliability of measurement systems, which are integral to various vision-based instrumentation and measurement applications. These systems often require clear and detailed images for precise object detection and recognition. However, images captured by visual measurement tools frequently suffer from degradation, including blurring and loss of detail, which can impede measurement accuracy.As a potential remedy, we in this paper propose a Semantic-Guided Global-Local Collaborative Network (SGGLC-Net) for lightweight SISR. Our SGGLC-Net leverages semantic priors extracted from a pre-trained model to guide the super-resolution process, enhancing image detail quality effectively. Specifically,we propose a Semantic Guidance Module that seamlessly integrates the semantic priors into the super-resolution network, enabling the network to more adeptly capture and utilize semantic priors, thereby enhancing image details. To further explore both local and non-local interactions for improved detail rendition,we propose a Global-Local Collaborative Module, which features three Global and Local Detail Enhancement Modules, as well as a Hybrid Attention Mechanism to work together to efficiently learn more useful features. Our extensive experiments show that SGGLC-Net achieves competitive PSNR and SSIM values across multiple benchmark datasets, demonstrating higher performance with the multi-adds reduction of 12.81G compared to state-of-the-art lightweight super-resolution approaches. These improvements underscore the potential of our approach to enhance the precision and effectiveness of visual measurement systems. Codes are at https://github.com/fanamber831/SGGLC-Net.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。