用自注意力机制端到端分割屋顶平面,精准捕捉边缘细节。
RoofSeg: An edge-aware transformer-based network for end-to-end roof plane segmentation
- 基于可学习查询的变换器框架,实现真正端到端分割
- 边缘感知模块提升边缘区域特征区分度,减少误分割
- 结合几何约束损失与自适应权重,优化训练效果
从机载激光雷达点云中进行屋顶平面分割是构建三维建筑模型(LoD 2/3)的关键步骤。现有深度学习方法虽优于传统方法,但仍存在三大问题:非真正端到端、边缘区域特征区分度低导致边缘不准确、几何特性未充分用于约束训练。为此,提出一种新型边缘感知的变换器网络 RoofSeg,采用编码器-解码器结构,通过一组可学习的平面查询分层预测平面实例掩码。为提升边缘分割精度,设计边缘感知掩码模块(EAMM),融合平面几何先验增强边缘判别力。同时,引入自适应加权策略降低误分类点影响,并提出新的平面几何损失以约束网络训练,实现更精确的端到端分割。
原文摘要 · Abstract (English)
Roof plane segmentation is one of the key procedures for reconstructing three-dimensional (3D) building models at levels of detail (LoD) 2 and 3 from airborne light detection and ranging (LiDAR) point clouds. The majority of current approaches for roof plane segmentation rely on the manually designed or learned features followed by some specifically designed geometric clustering strategies. Because the learned features are more powerful than the manually designed features, the deep learning-based approaches usually perform better than the traditional approaches. However, the current deep learning-based approaches have three unsolved problems. The first is that most of them are not truly end-to-end, the plane segmentation results may be not optimal. The second is that the point feature discriminability near the edges is relatively low, leading to inaccurate planar edges. The third is that the planar geometric characteristics are not sufficiently considered to constrain the network training. To solve these issues, a novel edge-aware transformer-based network, named RoofSeg, is developed for segmenting roof planes from LiDAR point clouds in a truly end-to-end manner. In the RoofSeg, we leverage a transformer encoder-decoder-based framework to hierarchically predict the plane instance masks with the use of a set of learnable plane queries. To further improve the segmentation accuracy of edge regions, we also design an Edge-Aware Mask Module (EAMM) that sufficiently incorporates planar geometric prior of edges to enhance its discriminability for plane instance mask refinement. In addition, we propose an adaptive weighting strategy in the mask loss to reduce the influence of misclassified points, and also propose a new plane geometric loss to constrain the network training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。