无需真实数据,用几何不变性与光谱低秩性修复高光谱图像。
SHARE: A Fully Unsupervised Framework for Single Hyperspectral Image Restoration
- 利用几何变换下的等变一致性自监督,不依赖真实标签。
- 动态光谱注意力模块增强全局低秩特性与局部相关性建模。
- 在无监督修复任务中性能接近有监督方法,适合真实场景应用。
高光谱图像(HSI)修复是计算成像与计算机视觉中的基础挑战,涉及如插补、超分辨率等不适定逆问题。尽管深度学习通过数据驱动方法推动了该领域发展,但其效果高度依赖精心构建的真实标注数据集,这在真实场景中难以获取。本文提出 SHARE(基于等变性的单幅高光谱图像修复),一种完全无监督框架,将几何等变性原理与低秩光谱建模相结合,彻底消除对真实标签的需求。核心思想是利用高光谱结构在可微几何变换(如旋转、缩放)下的内在不变性,通过等变一致性约束生成自监督信号。提出的动态自适应光谱注意力(DASA)模块进一步强化此范式,显式编码高光谱的全局低秩特性,并通过可学习注意力机制自适应优化局部光谱-空间相关性。在高光谱插补与超分辨率任务上的大量实验表明,SHARE 能有效提升修复质量,显著优于多项现有无监督方法,且性能接近有监督方法。我们希望该方法为高光谱修复及更广泛的科学成像场景提供新思路。代码将发布于 https://github.com/xuwayyy/SHARE。
原文摘要 · Abstract (English)
Hyperspectral image (HSI) restoration is a fundamental challenge in computational imaging and computer vision. It involves ill-posed inverse problems, such as inpainting and super-resolution. Although deep learning methods have transformed the field through data-driven learning, their effectiveness hinges on access to meticulously curated ground-truth datasets. This fundamentally restricts their applicability in real-world scenarios where such data is unavailable. This paper presents SHARE (Single Hyperspectral Image Restoration with Equivariance), a fully unsupervised framework that unifies geometric equivariance principles with low-rank spectral modelling to eliminate the need for ground truth. SHARE's core concept is to exploit the intrinsic invariance of hyperspectral structures under differentiable geometric transformations (e.g. rotations and scaling) to derive self-supervision signals through equivariance consistency constraints. Our novel Dynamic Adaptive Spectral Attention (DASA) module further enhances this paradigm shift by explicitly encoding the global low-rank property of HSI and adaptively refining local spectral-spatial correlations through learnable attention mechanisms. Extensive experiments on HSI inpainting and super-resolution tasks demonstrate the effectiveness of SHARE. Our method outperforms many state-of-the-art unsupervised approaches and achieves performance comparable to that of supervised methods. We hope that our approach will shed new light on HSI restoration and broader scientific imaging scenarios. The code will be released at https://github.com/xuwayyy/SHARE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。