arXiv:2511.06751eess.IVcs.AI2025-11

提出新型架构,提升光谱解卷积成像的精度与效率。

Hierarchical Spatial-Frequency Aggregation for Spectral Deconvolution Imaging

  • 分层频域聚合框架将非线性过程转为线性映射,简化求解。
  • 在多个真实与仿真数据集上优于现有方法,内存与计算开销更低。
  • 适合需要高保真紧凑成像的科研与工业场景。

计算光谱成像(CSI)通过光学与算法协同设计实现实时高光谱成像,但传统方法存在体积大、保真度低的问题。近年来,基于点扩散函数(PSF)工程的光谱解卷积成像(SDI)方法实现了高保真紧凑型CSI设计。然而,SDI中的复合卷积-积分操作导致法方程系数矩阵依赖于场景,阻碍了成像先验的高效利用,也给精确重建带来挑战。为应对SDI中固有的数据依赖算子,本文提出分层空间-频域聚合展开框架(HSFAUF)。通过分解子问题并投影至频域,HSFAUF将非线性过程转化为线性映射,从而实现高效求解。此外,为在迭代优化中融合空间-频域先验,提出空间-频域聚合变压器(SFAT),显式聚合跨空间与频率域信息。将SFAT集成至HSFAUF,构建基于变压器的深度展开方法——层次化空间-频域聚合展开变压器(HSFAUT),用于求解SDI逆问题。系统仿真与真实实验表明,HSFAUT在不同SDI系统上均超越当前最优方法,且具有更低的内存与计算成本。

原文摘要 · Abstract (English)

Computational spectral imaging (CSI) achieves real-time hyperspectral imaging through co-designed optics and algorithms, but typical CSI methods suffer from a bulky footprint and limited fidelity. Therefore, Spectral Deconvolution imaging (SDI) methods based on PSF engineering have been proposed to achieve high-fidelity compact CSI design recently. However, the composite convolution-integration operations of SDI render the normal-equation coefficient matrix scene-dependent, which hampers the efficient exploitation of imaging priors and poses challenges for accurate reconstruction. To tackle the inherent data-dependent operators in SDI, we introduce a Hierarchical Spatial-Spectral Aggregation Unfolding Framework (HSFAUF). By decomposing subproblems and projecting them into the frequency domain, HSFAUF transforms nonlinear processes into linear mappings, thereby enabling efficient solutions. Furthermore, to integrate spatial-spectral priors during iterative refinement, we propose a Spatial-Frequency Aggregation Transformer (SFAT), which explicitly aggregates information across spatial and frequency domains. By integrating SFAT into HSFAUF, we develop a Transformer-based deep unfolding method, \textbf{H}ierarchical \textbf{S}patial-\textbf{F}requency \textbf{A}ggregation \textbf{U}nfolding \textbf{T}ransformer (HSFAUT), to solve the inverse problem of SDI. Systematic simulated and real experiments show that HSFAUT surpasses SOTA methods with cheaper memory and computational costs, while exhibiting optimal performance on different SDI systems.

光谱成像深度展开频域聚合变压器

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。