arXiv:2503.08140cs.CVcs.RO2025-03CVPR被引 10

基于八叉树的Transformer模型,实现地面与空中点云的跨视角定位

HOTFormerLoc: Hierarchical Octree Transformer for Versatile Lidar Place Recognition Across Ground and Aerial Views

  • 用八叉树构建多尺度注意力,捕捉不同粒度的空间语义特征
  • 在森林等复杂场景中,跨视角定位准确率提升5.5%至11.5%
  • 适合自动驾驶、无人机导航等需要跨视角定位的场景

我们提出HOTFormerLoc,一种基于八叉树的新型通用三维位置识别模型,适用于城市与森林环境中地面到地面及地面到空中视角的大型3D场景定位。设计了基于八叉树的多尺度注意力机制,以捕获跨粒度的空间与语义特征。为应对旋转激光雷达产生的点云密度不均问题,引入圆柱形八叉树注意力窗口,更好地反映实际分布。通过引入中继令牌,实现高效全局-局部交互与多尺度表征学习,计算成本降低。金字塔注意力池化模块生成鲁棒全局描述符,支持端到端定位。此外,我们构建了新数据集CS-Wild-Places,包含密集森林中航空与地面激光扫描的点云数据,具有代表性缺失、密度差异和噪声模式等挑战性特征。HOTFormerLoc在该基准上取得5.5%–11.5%的顶1平均召回率提升,并在主流城市与森林数据集上平均性能优于现有方法4.9%。代码与数据集见https://csiro-robotics.github.io/HOTFormerLoc。

原文摘要 · Abstract (English)

We present HOTFormerLoc, a novel and versatile Hierarchical Octree-based TransFormer, for large-scale 3D place recognition in both ground-to-ground and ground-to-aerial scenarios across urban and forest environments. We propose an octree-based multi-scale attention mechanism that captures spatial and semantic features across granularities. To address the variable density of point distributions from spinning lidar, we present cylindrical octree attention windows to reflect the underlying distribution during attention. We introduce relay tokens to enable efficient global-local interactions and multi-scale representation learning at reduced computational cost. Our pyramid attentional pooling then synthesises a robust global descriptor for end-to-end place recognition in challenging environments. In addition, we introduce CS-Wild-Places, a novel 3D cross-source dataset featuring point cloud data from aerial and ground lidar scans captured in dense forests. Point clouds in CS-Wild-Places contain representational gaps and distinctive attributes such as varying point densities and noise patterns, making it a challenging benchmark for cross-view localisation in the wild. HOTFormerLoc achieves a top-1 average recall improvement of 5.5% - 11.5% on the CS-Wild-Places benchmark. Furthermore, it consistently outperforms SOTA 3D place recognition methods, with an average performance gain of 4.9% on well-established urban and forest datasets. The code and CS-Wild-Places benchmark is available at https://csiro-robotics.github.io/HOTFormerLoc.

点云定位八叉树跨视角激光雷达

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。