arXiv:2603.05473cs.CV2026-03

用神经辐射场重建红外光谱气体烟羽三维场景,提升检测精度。

Towards 3D Scene Understanding of Gas Plumes in LWIR Hyperspectral Images Using Neural Radiance Fields

  • 基于Mip-NeRF改进,融合高光谱与稀疏视角技术
  • 仅需30张图即达39.8dB PSNR,训练图像减半
  • 烟羽检测AUC达0.821,适合低数据场景分析

高光谱图像(HSI)在环境监测与国家安全等领域有广泛应用,可用于物质检测与识别。长波红外(LWIR)HSI可用于气体烟羽检测与分析。通常仅有少量场景图像,且单独分析。将多视图信息融合为统一表征,可增强对场景几何与光谱特性的理解。神经辐射场(NeRF)能生成体素场景属性的隐式神经表示,支持新视角渲染与几何重建,为高光谱三维场景重建提供可能。本文探索使用NeRF从LWIR HSI重建三维场景,并验证其在气体烟羽检测这一基础下游任务中的有效性。采用物理驱动的DIRSIG软件生成包含强六氟化硫气体烟羽的简易设施多视角LWIR HSI合成数据集。方法基于标准Mip-NeRF架构,结合前沿高光谱NeRF与稀疏视角NeRF技术,并引入新型自适应加权MSE损失。最终模型训练所需图像量较标准Mip-NeRF减少约50%,在仅30张训练图像下平均PSNR达39.8 dB。利用自适应相干性估计器在NeRF渲染测试图像上进行烟羽检测,相比真实标注掩膜,平均AUC达0.821。

原文摘要 · Abstract (English)

Hyperspectral images (HSI) have many applications, ranging from environmental monitoring to national security, and can be used for material detection and identification. Longwave infrared (LWIR) HSI can be used for gas plume detection and analysis. Oftentimes, only a few images of a scene of interest are available and are analyzed individually. The ability to combine information from multiple images into a single, cohesive representation could enhance analysis by providing more context on the scene's geometry and spectral properties. Neural radiance fields (NeRFs) create a latent neural representation of volumetric scene properties that enable novel-view rendering and geometry reconstruction, offering a promising avenue for hyperspectral 3D scene reconstruction. We explore the possibility of using NeRFs to create 3D scene reconstructions from LWIR HSI and demonstrate that the model can be used for the basic downstream analysis task of gas plume detection. The physics-based DIRSIG software suite was used to generate a synthetic multi-view LWIR HSI dataset of a simple facility with a strong sulfur hexafluoride gas plume. Our method, built on the standard Mip-NeRF architecture, combines state-of-the-art methods for hyperspectral NeRFs and sparse-view NeRFs, along with a novel adaptive weighted MSE loss. Our final NeRF method requires around 50% fewer training images than the standard Mip-NeRF and achieves an average PSNR of 39.8 dB with as few as 30 training images. Gas plume detection applied to NeRF-rendered test images using the adaptive coherence estimator achieves an average AUC of 0.821 when compared with detection masks generated from ground-truth test images.

三维重建气体检测神经辐射场红外成像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。