arXiv:2506.02601cs.CVeess.IV2025-06被引 2

用解混引导的扩散模型生成高光谱图像,提升质量与多样性。

Hyperspectral Image Generation with Unmixing Guided Diffusion Model

  • 通过解混自编码器将图像映射到低维丰度空间,降低计算负担。
  • 设计丰度扩散过程,确保合成数据满足非负和归一化物理约束。
  • 专为高光谱特性设计评估指标,适合遥感与医学图像生成研究者。

我们针对高光谱图像(HSI)合成问题,提出一种受解混引导的扩散框架。现有条件生成方法限制了样本多样性,而直接将扩散模型从RGB扩展至高光谱域面临高维光谱与严格物理约束的挑战。为此,方法包含两个协同组件:(i) 解混自编码器,将生成过程从图像空间投影至低维丰度流形,减少计算开销并保持光谱保真度;(ii) 丰度扩散过程,强制执行非负性和和为1的物理约束,保证合成数据的物理一致性。此外,提出两种专为高光谱特性设计的评估指标。综合实验表明,该方法在传统指标与新指标上均优于现有方法,生成的高光谱图像兼具高质量与高多样性,推动了高光谱数据生成的技术前沿。

原文摘要 · Abstract (English)

We address hyperspectral image (HSI) synthesis, a problem that has garnered growing interest yet remains constrained by the conditional generative paradigms that limit sample diversity. While diffusion models have emerged as a state-of-the-art solution for high-fidelity image generation, their direct extension from RGB to hyperspectral domains is challenged by the high spectral dimensionality and strict physical constraints inherent to HSIs. To overcome the challenges, we introduce a diffusion framework explicitly guided by hyperspectral unmixing. The approach integrates two collaborative components: (i) an unmixing autoencoder that projects generation from the image domain into a low-dimensional abundance manifold, thereby reducing computational burden while maintaining spectral fidelity; and (ii) an abundance diffusion process that enforces non-negativity and sum-to-one constraints, ensuring physical consistency of the synthesized data. We further propose two evaluation metrics tailored to hyperspectral characteristics. Comprehensive experiments, assessed with both conventional measures and the proposed metrics, demonstrate that our method produces HSIs with both high quality and diversity, advancing the state of the art in hyperspectral data generation.

高光谱生成扩散模型解混遥感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。