用物理先验和编码测量提升高光谱图像重建的不确定性估计
Uncertainty Quantification in HSI Reconstruction using Physics-Aware Diffusion Priors and Optics-Encoded Measurements
- 基于贝叶斯框架,用无条件训练的扩散模型生成符合测量的多样高光谱图像
- 在多种成像模型下,编码测量使不确定性估计更准确且信息量更丰富
- 适合关注高光谱重建可信度与物理建模的研究者
从压缩测量中重建高光谱图像是一个高度病态的逆问题。现有数据驱动方法因数据集光谱多样性不足,在评估色异构现象时易产生幻觉。本文将高光谱图像(HSI)重建建模为贝叶斯推断问题,提出HSDiff框架:利用无条件训练的像素级扩散先验和后验扩散采样,生成与多种高光谱成像模型测量一致的多样化HSI样本。我们提出一种增强的色异构增广技术,结合区域色异构黑点与并集分割光谱上采样,扩充具有物理合理性的色异构谱训练数据,强化先验多样性并改善不确定性校准。通过该框架,我们研究了不同前向模型如何影响后验分布,并证明有效光谱编码能提供校准过的、信息丰富的不确定性估计,优于非编码模型。在贝叶斯视角下,HSDiff提供了完整且高性能的不确定性感知高光谱重建方法。结果也重申了有效光谱编码在快照式高光谱成像中的重要性。
原文摘要 · Abstract (English)
Hyperspectral image reconstruction from a compressed measurement is a highly ill-posed inverse problem. Current data-driven methods suffer from hallucination due to the lack of spectral diversity in existing hyperspectral image datasets, particularly when they are evaluated for the metamerism phenomenon. In this work, we formulate hyperspectral image (HSI) reconstruction as a Bayesian inference problem and propose a framework, HSDiff, that utilizes an unconditionally trained, pixel-level diffusion prior and posterior diffusion sampling to generate diverse HSI samples consistent with the measurements of various hyperspectral image formation models. We propose an enhanced metameric augmentation technique using region-based metameric black and partition-of-union spectral upsampling to expand training with physically valid metameric spectra, strengthening the prior diversity and improving uncertainty calibration. We utilize HSDiff to investigate how the studied forward models shape the posterior distribution and demonstrate that guiding with effective spectral encoding provides calibrated informative uncertainty compared to non-encoded models. Through the lens of the Bayesian framework, HSDiff offers a complete, high-performance method for uncertainty-aware HSI reconstruction. Our results also reiterate the significance of effective spectral encoding in snapshot hyperspectral imaging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。