arXiv:2602.10858cs.CV2026-02

用高光谱成像提升烟雾分割精度,解决云层和半透明烟雾难题。

Hyperspectral Smoke Segmentation via Mixture of Prototypes

  • 采用原型混合网络,分阶段自适应加权不同波段信息。
  • 在20个真实场景中构建首个高光谱烟雾数据集,含1.8万帧标注。
  • 适用于火灾监测与工业安全,尤其适合复杂光照环境。

烟雾分割对野火管理与工业安全至关重要。传统可见光方法因光谱信息不足,难以应对云层干扰及半透明烟雾区域。为此,本文引入高光谱成像并提出首个高光谱烟雾分割数据集(HSSDataset),基于20个真实场景中超过18,000帧的图像,采用多对一标注协议进行精细标注。由于不同波段在空间区域上的区分能力差异,需设计自适应波段加权策略。本文将挑战分解为三方面:光谱交互污染、有限的光谱模式建模与复杂的加权路由问题。提出原型混合网络(MoP),包含:(1) 波段分离(BS)实现光谱隔离,(2) 原型驱动的光谱表示(PSR)捕捉多样模式,(3) 双阶段路由(DSR)实现空间感知的自适应加权。同时构建了多光谱数据集(MSSDataset),包含RGB-红外图像。大量实验验证了在高光谱与多光谱模态下的优越性能,确立了基于光谱的烟雾分割新范式。

原文摘要 · Abstract (English)

Smoke segmentation is critical for wildfire management and industrial safety applications. Traditional visible-light-based methods face limitations due to insufficient spectral information, particularly struggling with cloud interference and semi-transparent smoke regions. To address these challenges, we introduce hyperspectral imaging for smoke segmentation and present the first hyperspectral smoke segmentation dataset (HSSDataset) with carefully annotated samples collected from over 18,000 frames across 20 real-world scenarios using a Many-to-One annotations protocol. However, different spectral bands exhibit varying discriminative capabilities across spatial regions, necessitating adaptive band weighting strategies. We decompose this into three technical challenges: spectral interaction contamination, limited spectral pattern modeling, and complex weighting router problems. We propose a mixture of prototypes (MoP) network with: (1) band split (BS) for spectral isolation, (2) prototype-based spectral representation (PSR) for diverse patterns, and (3) dual-stage router (DSR) for adaptive spatial-aware band weighting. We further construct a multispectral dataset (MSSDataset) with RGB-infrared images. Extensive experiments validate superior performance across both hyperspectral and multispectral modalities, establishing a new paradigm for spectral-based smoke segmentation.

烟雾分割高光谱原型网络遥感应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。