arXiv:2604.27653cs.CV2026-04

提出FUN模型,端到端同时完成光谱成像重建与目标检测。

FUN: A Focal U-Net Combining Reconstruction and Object Detection for Snapshot Spectral Imaging

论文配图:FUN: A Focal U-Net Combining Reconstruction and Object Detection for Snapshot Spectral Imaging
图 1 · 摘自论文原文
  • 共享U型结构,重建与检测任务相互促进。
  • 用焦点调制替代自注意力,计算量降低30%。
  • 新数据集含363幅图像、8712个标注,支持评估。

传统推扫式高光谱成像采集速度慢,难以实现实时目标检测;而快照式光谱成像可瞬时获取高光谱图像(HSI),使实时检测成为可能,但其性能常受限于耗时的后期重建。为此,我们提出焦点U型网络(FUN),一种基于多任务学习的端到端框架,联合完成HSI重建与目标检测。FUN采用共享的U型主干网络,其中重建提供底层光谱信息,检测引导语义感知先验学习,促进任务间互益。关键在于,我们引入焦点调制机制,作为自注意力的高效替代,可调节空间与光谱特征,同时将计算复杂度从二次降低为线性,实现无自注意力的联合重建与检测架构。此外,我们构建了一个新的高光谱目标检测数据集,包含363幅高光谱图像和8712个标注对象,以支持方法评估。实验表明,FUN在两项任务上均达到当前最优性能,参数量减少40%,计算量降低30%,极具未来边缘实时部署潜力。代码与数据集已公开:https://github.com/ShawnDong98/FUN。

原文摘要 · Abstract (English)

Conventional push-broom hyperspectral imaging suffers from slow acquisition speeds, precluding real-time object detection; in contrast, snapshot spectral imaging enables instantaneous hyperspectral images (HSIs) capture, making real-time object detection feasible, yet its potential is often compromised by time-consuming post-capture reconstruction. To address this issue, we propose the Focal U-shaped Network (FUN), a novel end-to-end framework that jointly performs HSI reconstruction and object detection via multi-task learning. FUN employs a shared U-shaped backbone, where reconstruction provides underlying spectral information while detection guides semantic-aware priors learning, facilitating mutually beneficial task interaction. Crucially, we introduce focal modulation, an efficient alternative to self-attention that modulates spatial and spectral features while reducing quadratic computational complexity, enabling a self-attention-free architecture for joint reconstruction and detection. Furthermore, we contribute a new HSI object detection dataset with 8712 annotated objects across 363 HSIs to facilitate evaluation of the proposed method. Experiments demonstrate that FUN achieves state-of-the-art performance on both tasks, using 40% fewer parameters and 30% less computation than recent alternatives, making it promising for future real-time edge deployment. The code and datasets are available: https://github.com/ShawnDong98/FUN.

高光谱成像目标检测多任务学习轻量化模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。