用物理可解释的滤波器降低高光谱图像维度,提升城市驾驶分割精度。
Learnable Quantum Efficiency Filters for Urban Hyperspectral Segmentation
- 设计可学习的量子效率滤波器,约束光谱响应平滑且有单一主峰。
- 在三个数据集上平均提升1.04%以上mIoU,优于传统与可学习方法。
- 参数量少至12-36,适合车载系统,结果可解释性强。
高光谱感知为城市驾驶场景理解提供丰富光谱信息,但其高维特性给解读和高效学习带来挑战。本文提出可学习量子效率(LQE),一种受物理启发、可解释的降维方法,通过参数化平滑的高阶光谱响应函数,模拟合理的传感器量子效率曲线。与传统方法或无约束可学习层不同,LQE 引入物理驱动约束:单个主峰、平滑响应及有限带宽。该方法生成紧凑的光谱表示,在保留判别性信息的同时完全可微,可在语义分割模型中端到端训练。我们在三个公开的多类高光谱城市驾驶数据集上进行系统评估,对比六种传统与七种可学习基线方法,涵盖六种语义分割模型。平均来看,LQE 在 HyKo、HSI-Drive 与 Hyperspectral City 上分别比传统方法提升2.45%、0.45%、1.04%,比可学习方法提升1.18%、1.56%、0.81%。其参数效率高(12–36参数,对比竞争方法51–22,000参数),推理延迟具竞争力。消融实验表明低阶配置最优,学习到的光谱滤波器收敛至数据集内在波长模式。结果表明,物理引导的光谱学习能同时提升性能与可解释性,为自动驾驶视觉系统的感知与数据驱动多光谱传感器设计提供原则性桥梁。
原文摘要 · Abstract (English)
Hyperspectral sensing provides rich spectral information for scene understanding in urban driving, but its high dimensionality poses challenges for interpretation and efficient learning. We introduce Learnable Quantum Efficiency (LQE), a physics-inspired, interpretable dimensionality reduction (DR) method that parameterizes smooth high-order spectral response functions that emulate plausible sensor quantum efficiency curves. Unlike conventional methods or unconstrained learnable layers, LQE enforces physically motivated constraints, including a single dominant peak, smooth responses, and bounded bandwidth. This formulation yields a compact spectral representation that preserves discriminative information while remaining fully differentiable and end-to-end trainable within semantic segmentation models (SSMs). We conduct systematic evaluations across three publicly available multi-class hyperspectral urban driving datasets, comparing LQE against six conventional and seven learnable baseline DR methods across six SSMs. Averaged across all SSMs and configurations, LQE achieves the highest average mIoU, improving over conventional methods by 2.45\%, 0.45\%, and 1.04\%, and over learnable methods by 1.18\%, 1.56\%, and 0.81\% on HyKo, HSI-Drive, and Hyperspectral City, respectively. LQE maintains strong parameter efficiency (12--36 parameters compared to 51--22K for competing learnable approaches) and competitive inference latency. Ablation studies show that low-order configurations are optimal, while the learned spectral filters converge to dataset-intrinsic wavelength patterns. These results demonstrate that physics-informed spectral learning can improve both performance and interpretability, providing a principled bridge between hyperspectral perception and data-driven multispectral sensor design for automotive vision systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。