针对点云中小物体分割难问题,提出密度感知的全局局部注意力网络。
Density-aware global-local attention network for point cloud segmentation
- 按点密度自适应划分局部窗口计算注意力
- 通过类别响应损失提升小样本类别分割效果
- 适合处理含大量小物体的真实场景点云
3D点云分割在自动驾驶、增强现实、虚拟现实和数字孪生等领域有广泛应用。实际场景采集的点云常包含小物体及小样本类别,现有网络难以有效处理。为此,我们提出一种融合密度感知局部注意力与全局注意力的点云分割网络。核心思想是在扩大每个点有效感受野的同时,减少密集区域中小物体的信息损失。具体而言,根据不同密度划分不同大小的局部窗口以计算窗口内注意力;并将每个局部区域视为独立标记,用于整个输入的全局注意力。此外,设计了一种类别响应损失,以平衡不同类别和尺寸物体的处理。特别地,在网络中间增加一个全连接层,用于预测物体类别是否存在,并构建二值交叉熵损失以响应场景中类别的存在性。实验表明,该方法在多个公开数据集的语义分割和部件分割任务中表现优异。在包含大量微小物体的复杂真实场景点云上的实验也验证了其对小物体及小样本类别的强大分割能力。
原文摘要 · Abstract (English)
3D point cloud segmentation has a wide range of applications in areas such as autonomous driving, augmented reality, virtual reality and digital twins. The point cloud data collected in real scenes often contain small objects and categories with small sample sizes, which are difficult to handle by existing networks. In this regard, we propose a point cloud segmentation network that fuses local attention based on density perception with global attention. The core idea is to increase the effective receptive field of each point while reducing the loss of information about small objects in dense areas. Specifically, we divide different sized windows for local areas with different densities to compute attention within the window. Furthermore, we consider each local area as an independent token for the global attention of the entire input. A category-response loss is also proposed to balance the processing of different categories and sizes of objects. In particular, we set up an additional fully connected layer in the middle of the network for prediction of the presence of object categories, and construct a binary cross-entropy loss to respond to the presence of categories in the scene. In experiments, our method achieves competitive results in semantic segmentation and part segmentation tasks on several publicly available datasets. Experiments on point cloud data obtained from complex real-world scenes filled with tiny objects also validate the strong segmentation capability of our method for small objects as well as small sample categories.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。