arXiv:2605.13581cs.CV2026-05

用扩散模型生成适配目标域的高光谱图像,提升无干净样本场景下的修复效果。

HIR-ALIGN: Enhancing Hyperspectral Image Restoration via Diffusion-Based Data Generation

论文配图:HIR-ALIGN: Enhancing Hyperspectral Image Restoration via Diffusion-Based Data Generation
图 1 · 摘自论文原文
  • 通过代理图像和扩散模型生成与目标域匹配的合成数据,实现无监督域自适应增强。
  • 在多个真实与模拟数据集上,修复性能显著优于基线方法,尤其在噪声和模糊场景下表现突出。
  • 适合缺乏干净目标域数据的高光谱图像修复任务,如遥感、医学成像等实际应用。

高光谱图像(HSI)修复对可靠分析至关重要,因真实世界中的HSI常受噪声、模糊和分辨率损失影响。然而,基于源域数据训练的模型在缺乏干净参考的目标域上表现不佳,这是常见现实场景。为此,我们提出HIR-ALIGN,一种即插即用的目标自适应增强框架,通过生成与目标分布匹配的合成数据来增强有限训练图像,无需额外清洁的目标域HSI。该框架包含三个阶段:(i) 代理生成,将现成的修复模型应用于退化的目标观测,生成保持语义的代理HSI,近似清洁的目标域图像;(ii) 分布自适应合成,使用鲁棒模糊的unCLIP扩散模型,以提示条件和嵌入空间噪声初始化生成目标对齐的RGB图像;随后通过基于形变的光谱迁移模块,将每个生成的RGB与对应代理RGB对齐,估计软块级传输权重,并结合可学习局部插值核作用于代理HSI,生成合成HSI;(iii) 对齐监督微调,将源分布预训练的修复网络用代理HSI与合成目标对齐的HSI进行微调,再部署于退化的目标图像。我们还提供了理论分析表明,在给定假设下,该增强微调方法通过同时提升目标分布覆盖度并控制光谱偏差,获得更紧的目标域修复风险上界。在模拟和真实数据集上的多任务实验(去噪、超分辨等)表明,HIR-ALIGN优于仅使用代理的自适应基线,且在多数情况下超越代表性无监督方法。

原文摘要 · Abstract (English)

Hyperspectral image (HSI) restoration is crucial for reliable analysis, as real-world HSIs suffer from noise, blur, and resolution loss. However, existing models trained on source data often fail on target domains lacking clean references, a common real-world scenario. To address this, we present HIR-ALIGN, a plug-and-play target-adaptive augmentation framework that enhances HSI restoration by augmenting limited training images with synthetic data matching the target distribution, without extra clean target-domain HSI data. It has three stages: (i) proxy generation, where off-the-shelf restoration models are applied to degraded target observations to produce semantics-preserving proxy HSIs that approximate clean target-domain images; (ii) distribution-adaptive synthesis, where a blur-robust unCLIP diffusion model generates target-aligned RGBs from proxy RGBs with prompt conditioning and embedding-space noise initialization. The warp-based spectral transfer module then synthesizes HSIs by aligning each generated RGB with its proxy RGB, estimating soft patch-wise transport weights, and applying these weights and learnable local interpolation kernels to the proxy HSI; and (iii) aligned supervised finetuning, where restoration networks pretrained on the source distribution are finetuned with proxy HSIs and synthesized target-aligned HSIs, then deployed on degraded target images. We also provide theoretical analysis showing that, under stated assumptions, the proposed augmentation-based finetuning obtains a tighter target-domain restoration-risk upper bound by jointly improving target-distribution coverage and controlling spectral bias. Experiments on simulated and real datasets across denoising, super-resolution, and other restoration tasks demonstrate that HIR-ALIGN is superior to proxy-only target-adaptation baselines and outperforms representative unsupervised methods in most cases.

高光谱修复扩散模型域自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。