arXiv:2412.08195cs.ROcs.AI2024-12

融合激光与单目图像,精准建模非结构化地形的可通行区域。

3DTTNet: Multimodal Fusion-Based 3D Traversable Terrain Modeling for Off-Road Environments

  • 通过激光点云与单目图像多模态融合,增强复杂地形特征提取。
  • 在非结构化地形上实现42%的场景完成度提升,优于现有方法。
  • 适用于多种车辆平台,支持动态模型扩展,适合越野自动驾驶应用。

非结构化越野环境对自主地面车辆构成重大挑战,因缺乏规则道路及存在不平地形、植被遮挡等复杂障碍。传统感知算法主要针对有结构环境设计,在无序场景中表现不佳。本文通过语义场景补全实现可通行区域识别,提出一种新型多模态方法3DTTNet,结合前视单目图像与激光雷达点云,生成稠密可通行地形估计。通过多模态数据融合,强化环境特征提取能力,对复杂地形建模至关重要。此外,提出包含三维可通行标注的RELLIS-OCC数据集,涵盖台阶高度、坡度和不平整度等几何特征。结合车辆越障条件分析与车身结构约束,生成四类可通行成本标签:致命、中等代价、低代价、自由通行。实验表明,3DTTNet在非结构化越野环境中显著优于对比方法,尤其在几何不规则与部分遮挡场景下,场景完成度交并比(IoU)提升42%。所提框架具备可扩展性,适配不同车辆平台,支持占用网格参数调整与先进动态模型集成,用于可通行性成本估计。

原文摘要 · Abstract (English)

Off-road environments remain significant challenges for autonomous ground vehicles, due to the lack of structured roads and the presence of complex obstacles, such as uneven terrain, vegetation, and occlusions. Traditional perception algorithms, primarily designed for structured environments, often fail in unstructured scenarios. In this paper, traversable area recognition is achieved through semantic scene completion. A novel multimodal method, 3DTTNet, is proposed to generate dense traversable terrain estimations by integrating LiDAR point clouds with monocular images from a forward-facing perspective. By integrating multimodal data, environmental feature extraction is strengthened, which is crucial for accurate terrain modeling in complex terrains. Furthermore, RELLIS-OCC, a dataset with 3D traversable annotations, is introduced, incorporating geometric features such as step height, slope, and unevenness. Through a comprehensive analysis of vehicle obsta cle-crossing conditions and the incorporation of vehicle body structure constraints, four traversability cost labels are generated: lethal, medium-cost, low-cost, and free. Experimental results demonstrate that 3DTTNet outperforms the comparison approaches in 3D traversable area recognition, particularly in off-road environments with irregular geometries and partial occlusions. Specifically, 3DTTNet achieves a 42\% improvement in scene completion IoU compared to other models. The proposed framework is scalable and adaptable to various vehicle platforms, allowing for adjustments to occupancy grid parameters and the integration of advanced dynamic models for traversability cost estimation.

三维建模多模态融合越野导航可通行性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。