arXiv:2504.09506cs.CV2025-04被引 10

提出首个面向机载高光谱点云的3D目标检测方法,解决几何-光谱失真问题。

Pillar-Voxel Fusion Network for 3D Object Detection in Airborne Hyperspectral Point Clouds

  • 采用柱状-体素双分支编码器,分别捕捉光谱与空间特征
  • 多层级融合机制实现特征对齐与自适应选择,提升检测精度
  • 在两个机载数据集上达到领先性能,适合高精度遥感目标识别

高光谱点云(HPCs)能同时表征地物的三维空间与光谱信息,具备优异的三维感知与目标识别能力。现有生成HPCs的方法通常将高光谱图像与激光雷达点云融合,但融合误差和遮挡导致几何-光谱失真,限制了其在多种场景下细粒度任务的表现,尤其在机载应用中更为显著。为此,本文提出PiV-AHPC,首个针对机载高光谱点云的3D目标检测网络。我们设计柱状-体素双分支编码器:前者从HPCs中提取光谱与垂直结构特征以缓解光谱失真,后者专注于点云中精确的三维空间特征提取。引入多层级特征融合机制,实现两分支间的高效信息交互,完成邻域特征对齐与通道自适应选择,有机融合异构特征并减轻几何畸变。在两个机载HPCs数据集上的大量实验表明,PiV-AHPC具备当前最优检测性能与强泛化能力。

原文摘要 · Abstract (English)

Hyperspectral point clouds (HPCs) can simultaneously characterize 3D spatial and spectral information of ground objects, offering excellent 3D perception and target recognition capabilities. Current approaches for generating HPCs often involve fusion techniques with hyperspectral images and LiDAR point clouds, which inevitably lead to geometric-spectral distortions due to fusion errors and obstacle occlusions. These adverse effects limit their performance in downstream fine-grained tasks across multiple scenarios, particularly in airborne applications. To address these issues, we propose PiV-AHPC, a 3D object detection network for airborne HPCs. To the best of our knowledge, this is the first attempt at this HPCs task. Specifically, we first develop a pillar-voxel dual-branch encoder, where the former captures spectral and vertical structural features from HPCs to overcome spectral distortion, while the latter emphasizes extracting accurate 3D spatial features from point clouds. A multi-level feature fusion mechanism is devised to enhance information interaction between the two branches, achieving neighborhood feature alignment and channel-adaptive selection, thereby organically integrating heterogeneous features and mitigating geometric distortion. Extensive experiments on two airborne HPCs datasets demonstrate that PiV-AHPC possesses state-of-the-art detection performance and high generalization capability.

3D检测高光谱点云处理遥感

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。