构建标准化合成评估框架,让高光谱超分辨率方法对比更公平可靠。
HyperBench: Standardizing and Scaling Synthetic Evaluation for Hyperspectral Super-Resolution

- 设计统一实验框架,支持多种退化参数组合
- 六种方法对比显示性能差距从5dB扩大到13dB
- 适合希望公平比较或复现结果的研究者
高光谱超分辨率(HSR)通过融合低分辨率高光谱图像(LR-HSI)与高分辨率多光谱图像(HR-MSI),重建高空间分辨率的高光谱图像。由于缺乏真实配对数据,现有方法几乎都依赖基于高光谱数据集的合成实验,采用Wald协议生成。然而,各研究实现差异大,通常仅使用单一(通常是高斯型)点扩散函数(PSF)、少数几个光谱响应函数(SRF)和少量空间下采样因子。这导致性能结果难以跨文献比较、复现困难,且泛化性存疑。本文提出HyperBench,一个统一且可扩展的合成实验框架,支持十种PSF、四种来自实际多光谱传感器的SRF、可配置的空间下采样因子及匹配的加性白噪声。其目标是实现大规模评估的自动化与结构化日志记录。通过解耦模型开发与实验设计,该框架使跨方法比较更可复现、摩擦更小。我们在四个常用高光谱场景上,对六种最新提出的HSR方法进行了70种配置的全面评估,发现不同方法间的PSNR差距从最简单退化条件下的约5 dB扩大至最复杂条件下的超过13 dB,这一脆弱性在当前单配置评估中完全不可见。代码已开源:https://github.com/ritikgshah/HyperBench。
原文摘要 · Abstract (English)
Hyperspectral super-resolution (HSR) reconstructs a high-spatial-resolution hyperspectral image by fusing a low-resolution hyperspectral image (LR-HSI) with a high-resolution multispectral image (HR-MSI). In the absence of real-world paired data, HSR methods are evaluated almost exclusively on synthetic experiments derived from hyperspectral datasets through Wald's protocol. Despite the protocol's widespread adoption, its practical implementation varies markedly across research works, typically relying on a single (usually Gaussian) or very few point spread functions (PSFs), one or two spectral response functions (SRFs), and a couple of spatial downsampling factors. As a result, reported performance figures are difficult to compare across the literature, in addition to being often difficult to reproduce; furthermore, they may not generalize across realistic sensing conditions. We introduce HyperBench, a unified and extensible framework that standardizes synthetic experimentation for HSR. HyperBench supports diverse degradation configurations spanning ten PSFs, four SRFs derived from operational multispectral sensors, configurable spatial downsampling factors, and matched additive white Gaussian noise; its goal is to automate large-scale evaluation and structured logging. By decoupling model development from experimental design, the framework enables reproducible, apples-to-apples cross-method comparison with minimal friction. We use HyperBench to evaluate six recently proposed HSR methods across a 70-configuration sweep on four widely used hyperspectral scenes and observe that the inter-method PSNR spread widens from approximately 5 dB on the easiest PSF to over 13 dB on the hardest - a fragility that is structurally invisible to the prevailing single-configuration evaluation protocol. HyperBench code is available at https://github.com/ritikgshah/HyperBench .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。