用几何引导的高斯点云实现任意尺度高光谱图像超分辨率
Voronoi-guided Bilateral 2D Gaussian Splatting for Arbitrary-Scale Hyperspectral Image Super-Resolution

- 基于沃罗诺伊图选择相关高斯函数,实现灵活空间重建
- 在多个数据集上优于现有方法,支持任意缩放因子
- 适合需要跨尺度重建的遥感图像处理任务
现有高光谱图像超分辨率方法需针对不同尺度进行调整,限制了其在任意尺度重建中的灵活性。2D高斯点云提供连续表示,兼容任意尺度超分辨率,但现有方法多依赖栅格化策略,难以灵活建模空间结构。将此类方法拓展至高光谱图像超分辨率仍具挑战,因需同时实现自适应空间重建与光谱保真。本文提出GaussianHSI,一种基于高斯点云的任意尺度高光谱图像超分辨率框架。设计沃罗诺伊引导的双边2D高斯点云方法,先预测一组高斯函数表示输入,再通过沃罗诺伊引导选择与目标像素相关的高斯函数;目标像素由选定高斯函数经参考感知双边加权聚合重建,兼顾几何相关性与低分辨率特征一致性。此外引入光谱细节增强模块以提升光谱重建质量。在多个基准数据集上的大量实验表明,GaussianHSI在任意尺度高光谱图像超分辨率任务中显著优于现有先进方法。
原文摘要 · Abstract (English)
Most existing hyperspectral image super-resolution methods require modifications for different scales, limiting their flexibility in arbitrary-scale reconstruction. 2D Gaussian splatting provides a continuous representation that is compatible with arbitrary-scale super-resolution. Existing methods often rely on rasterization strategies, which may limit flexible spatial modeling. Extending them to hyperspectral image super-resolution remains challenging, as the task requires adaptive spatial reconstruction while preserving spectral fidelity. This paper proposes GaussianHSI, a Gaussian-Splatting-based framework for arbitrary-scale hyperspectral image super-resolution. We develop a Voronoi-Guided Bilateral 2D Gaussian Splatting for spatial reconstruction. After predicting a set of Gaussian functions to represent the input, it associates each target pixel with relevant Gaussian functions through Voronoi-guided selection. The target pixel is then reconstructed by aggregating the selected Gaussian functions with reference-aware bilateral weighting, which considers both geometric relevance and consistency with low-resolution features. We further introduce a Spectral Detail Enhancement module to improve spectral reconstruction. Extensive experiments on benchmark datasets demonstrate the effectiveness of GaussianHSI over state-of-the-art methods for arbitrary-scale hyperspectral image super-resolution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。