arXiv:2505.16658cs.CVeess.IV2025-05被引 7

提出一种无需训练的高光谱锐化方法,确保各波段质量一致。

Zero-Shot Hyperspectral Pansharpening Using Hysteresis-Based Tuning for Spectral Quality Control

  • 用轻量网络动态调整每波段权重,自适应提升精度。
  • 通过滞回机制控制空间损失开关,加速光谱损失收敛。
  • 全无监督设计,适合缺乏标注数据的高光谱处理场景。

高光谱锐化近年来因技术与方法进步受到关注,但研究仍处于起步阶段。现有主流方法多借鉴成熟的多光谱锐化技术,常忽视高光谱数据融合的独特挑战:波段数量极多、部分波段噪声严重、全色与高光谱成分间存在显著光谱失配、分辨率比例通常很高。不精确的数据建模尤其影响光谱保真度,即使顶尖方法在某些波段表现良好,其他波段则明显下降,难以保证全波段一致性,有生成不可靠结果的风险。本文提出一种新型高光谱锐化方法,明确解决该问题并确保各波段质量均匀。采用单一轻量级神经网络,其权重能针对每个波段实时自适应调整。在微调过程中,依据类似滞回的动态机制,周期性开启与关闭空间损失,以快速将光谱损失收敛至目标水平;同时重新定义空间损失,以捕捉全色与光谱波段间的非线性关系。整体方法完全无监督,无需外部预训练,灵活且计算复杂度低。在近期发布的基准测试工具箱上的实验表明,该方法在所有波段上均实现优异锐化效果,性能媲美最先进方法。代码与完整结果已公开于 https://github.com/giu-guarino/rho-PNN。

原文摘要 · Abstract (English)

Hyperspectral pansharpening has received much attention in recent years due to technological and methodological advances that open the door to new application scenarios. However, research on this topic is only now gaining momentum. The most popular methods are still borrowed from the more mature field of multispectral pansharpening and often overlook the unique challenges posed by hyperspectral data fusion, such as i) the very large number of bands, ii) the overwhelming noise in selected spectral ranges, iii) the significant spectral mismatch between panchromatic and hyperspectral components, iv) a typically high resolution ratio. Imprecise data modeling especially affects spectral fidelity. Even state-of-the-art methods perform well in certain spectral ranges and much worse in others, failing to ensure consistent quality across all bands, with the risk of generating unreliable results. Here, we propose a hyperspectral pansharpening method that explicitly addresses this problem and ensures uniform spectral quality. To this end, a single lightweight neural network is used, with weights that adapt on the fly to each band. During fine-tuning, the spatial loss is turned on and off to ensure a fast convergence of the spectral loss to the desired level, according to a hysteresis-like dynamic. Furthermore, the spatial loss itself is appropriately redefined to account for nonlinear dependencies between panchromatic and spectral bands. Overall, the proposed method is fully unsupervised, with no prior training on external data, flexible, and low-complexity. Experiments on a recently published benchmarking toolbox show that it ensures excellent sharpening quality, competitive with the state-of-the-art, consistently across all bands. The software code and the full set of results are shared online on https://github.com/giu-guarino/rho-PNN.

高光谱锐化无监督图像融合

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。