arXiv:2602.00749cs.CV2026-02被引 1

用自回归方法提升高光谱图像修复速度与细节保留

HSI-VAR: Rethinking Hyperspectral Restoration through Spatial-Spectral Visual Autoregression

  • 将高光谱修复建模为渐进式自回归生成,分步建模空间谱域依赖
  • 比扩散模型快95.5倍,修复精度提升3.77 dB(ICVL数据集)
  • 自动识别多种退化组合,适合实际高维图像快速修复场景

高光谱图像(HSI)包含超越RGB的丰富空间-谱信息,但真实场景中常面临噪声、模糊和波段缺失等复合退化。现有生成方法如扩散模型需数百次迭代,计算成本高;回归模型则易产生过度平滑结果,损失结构细节。本文提出HSI-VAR,将高光谱修复重新定义为自回归生成问题,逐步建模空间与谱域依赖关系。核心创新包括:(1) 隐空间-条件嵌入对齐,确保语义一致性以实现精准重建;(2) 退化感知引导,将混合退化在嵌入空间编码为线性组合,实现自动控制,推理耗时降低近50%;(3) 空间-谱适应模块,在解码阶段协同优化多域细节。在九个综合基准测试中,HSI-VAR表现领先,于ICVL数据集上提升3.77 dB PSNR,推理速度较扩散模型最高提速95.5倍,兼具高效与保真优势。

原文摘要 · Abstract (English)

Hyperspectral images (HSIs) capture richer spatial-spectral information beyond RGB, yet real-world HSIs often suffer from a composite mix of degradations, such as noise, blur, and missing bands. Existing generative approaches for HSI restoration like diffusion models require hundreds of iterative steps, making them computationally impractical for high-dimensional HSIs. While regression models tend to produce oversmoothed results, failing to preserve critical structural details. We break this impasse by introducing HSI-VAR, rethinking HSI restoration as an autoregressive generation problem, where spectral and spatial dependencies can be progressively modeled rather than globally reconstructed. HSI-VAR incorporates three key innovations: (1) Latent-condition alignment, which couples semantic consistency between latent priors and conditional embeddings for precise reconstruction; (2) Degradation-aware guidance, which uniquely encodes mixed degradations as linear combinations in the embedding space for automatic control, remarkably achieving a nearly $50\%$ reduction in computational cost at inference; (3) A spatial-spectral adaptation module that refines details across both domains in the decoding phase. Extensive experiments on nine all-in-one HSI restoration benchmarks confirm HSI-VAR's state-of-the-art performance, achieving a 3.77 dB PSNR improvement on \textbf{\textit{ICVL}} and offering superior structure preservation with an inference speed-up of up to $95.5 \times$ compared with diffusion-based methods, making it a highly practical solution for real-world HSI restoration.

高光谱修复自回归生成图像恢复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。