针对红外图像超分辨率,提出保持光谱分布一致性的新框架。
Contourlet Refinement Gate Framework for Thermal Spectrum Distribution Regularized Infrared Image Super-Resolution
- 用轮廓波分解提取多尺度方向高频信息,通过门控结构恢复退化特征。
- 引入光谱保真损失,有效保留高低频成分与红外特有特征。
- 适合需要精准红外感知的下游任务,如夜视、热成像分析。
图像超分辨率(SR)是经典但持续活跃的低层视觉问题,旨在从低分辨率(LR)图像重建高分辨率(HR)图像,是图像增强的关键技术。现有基于Transformer或扩散模型的方法多聚焦于可见光图像特征提取,或假设相似退化模式,忽视了红外与可见图像的本质模态差异。直接应用于红外图像超分辨率时,这些方法会扭曲红外光谱分布,影响下游任务的机器感知性能。本文强调红外光谱分布保真性,提出轮廓波精炼门控框架(CoRPLE),通过多尺度多方向红外光谱分解捕获高频子带,利用门控结构恢复退化信息。提出的光谱保真损失在重建过程中正则化光谱频率分布,确保高低频成分完整,维持红外特有特征的保真度。采用两阶段提示学习优化策略,引导模型从低分辨率退化中学习高分辨率红外特征。大量实验表明,本方法在视觉与感知任务上优于现有模型,并显著提升下游任务的机器感知性能。代码已开源:https://github.com/hey-it-s-me/CoRPLE。
原文摘要 · Abstract (English)
Image super-resolution (SR) is a classical yet still active low-level vision problem that aims to reconstruct high-resolution (HR) images from their low-resolution (LR) counterparts, serving as a key technique for image enhancement. Current approaches to address SR tasks, such as transformer-based and diffusion-based methods, are either dedicated to extracting RGB image features or assuming similar degradation patterns, neglecting the inherent modal disparities between infrared and visible images. When directly applied to infrared image SR tasks, these methods inevitably distort the infrared spectral distribution, compromising the machine perception in downstream tasks. In this work, we emphasize the infrared spectral distribution fidelity and propose a Contourlet refinement gate framework to restore infrared modal-specific features while preserving spectral distribution fidelity. Our approach captures high-pass subbands from multi-scale and multi-directional infrared spectral decomposition to recover infrared-degraded information through a gate architecture. The proposed Spectral Fidelity Loss regularizes the spectral frequency distribution during reconstruction, which ensures the preservation of both high- and low-frequency components and maintains the fidelity of infrared-specific features. We propose a two-stage prompt-learning optimization to guide the model in learning infrared HR characteristics from LR degradation. Extensive experiments demonstrate that our approach outperforms existing image SR models in both visual and perceptual tasks while notably enhancing machine perception in downstream tasks. Our code is available at https://github.com/hey-it-s-me/CoRPLE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。