针对高光谱图像表示非均匀性问题,提出公平导向的分模块解决方案。
Equal is Not Always Fair: A New Perspective on Hyperspectral Representation Non-Uniformity
- 分三模块分别处理空间、特征与光谱非均匀性,实现维度自适应
- 在分类、去噪等四类任务中均超越现有方法,提升显著
- 适合需要高维视觉建模精度的研究者与工程师
高光谱图像(HSI)表示面临普遍存在的非均匀性挑战,其光谱相关性、空间连续性和特征效率表现出复杂且常冲突的行为。现有模型多采用统一处理范式,假设各维度同质,导致性能不佳和表征偏差。为此,我们提出公平导向框架 FairHyp,通过协作但专精的模块显式解耦并解决三重非均匀性。引入受龙格-库塔启发的空间变异性适配器,在分辨率差异下恢复空间一致性;设计多感受野卷积模块结合稀疏感知优化,增强判别特征同时尊重内在稀疏性;构建光谱-上下文状态空间模型,通过双向 Mamba 扫描与统计聚合捕捉稳定长程光谱依赖。不同于通用方案,FairHyp 实现维度特异性适应,保持全局一致性与相互增强。该设计基于非均匀性源于 HSI 表示内在结构而非特定任务的视角。我们在分类、去噪、超分辨率与修复四个代表性任务上验证其有效性,证明其能建模共享的结构性缺陷。大量实验表明,FairHyp 在多种成像条件下持续优于最先进方法。研究重新定义公平为 HSI 建模的结构性必要,提供高维视觉任务中可适应性、效率与保真度平衡的新范式。
原文摘要 · Abstract (English)
Hyperspectral image (HSI) representation is fundamentally challenged by pervasive non-uniformity, where spectral dependencies, spatial continuity, and feature efficiency exhibit complex and often conflicting behaviors. Most existing models rely on a unified processing paradigm that assumes homogeneity across dimensions, leading to suboptimal performance and biased representations. To address this, we propose FairHyp, a fairness-directed framework that explicitly disentangles and resolves the threefold non-uniformity through cooperative yet specialized modules. We introduce a Runge-Kutta-inspired spatial variability adapter to restore spatial coherence under resolution discrepancies, a multi-receptive field convolution module with sparse-aware refinement to enhance discriminative features while respecting inherent sparsity, and a spectral-context state space model that captures stable and long-range spectral dependencies via bidirectional Mamba scanning and statistical aggregation. Unlike one-size-fits-all solutions, FairHyp achieves dimension-specific adaptation while preserving global consistency and mutual reinforcement. This design is grounded in the view that non-uniformity arises from the intrinsic structure of HSI representations, rather than any particular task setting. To validate this, we apply FairHyp across four representative tasks including classification, denoising, super-resolution, and inpaintin, demonstrating its effectiveness in modeling a shared structural flaw. Extensive experiments show that FairHyp consistently outperforms state-of-the-art methods under varied imaging conditions. Our findings redefine fairness as a structural necessity in HSI modeling and offer a new paradigm for balancing adaptability, efficiency, and fidelity in high-dimensional vision tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。