通过局部分裂注意力与并行聚合提升点云分割的上下文感知能力,兼顾精度与效率。
Efficiently Expanding Receptive Fields: Local Split Attention and Parallel Aggregation for Enhanced Large-scale Point Cloud Semantic Segmentation
- 采用局部分裂注意力池化机制,分步扩展感受野,降低计算开销。
- 引入并行聚合模块,融合2D与3D邻域信息,增强上下文表征能力。
- 在三大数据集上性能超越主流方法,速度提升约38.8%。
在大规模3D点云语义分割中,扩展深度学习模型的感受野有助于捕捉丰富上下文信息,从而提升网络学习有意义特征的能力。然而,这常导致计算复杂度上升和过拟合风险,影响学习范式的效率与有效性。为此,本文提出局部分裂注意力池化(LSAP)机制,通过一系列局部分裂操作有效扩展感受野,促进获取更广范围的上下文知识,同时优化注意力池化层的计算负载,实现更高效的处理流程。基于LSAP,进一步设计了并行聚合增强(PAE)模块,支持利用2D与3D邻域信息进行并行数据处理,进一步强化网络中的上下文表达。据此构建了新型框架LSNet。大量实验表明,将所提PAE模块无缝集成至现有框架可显著提升平均交并比(mIoU),最高提升达11%。在S3DIS、Toronto3D和SensatUrban三个基准数据集上,LSNet性能优于当前最先进方法。值得注意的是,相较于采用相似感受野的模型,本方法实现约38.8%的速度提升,凸显其计算效率与实际应用价值。
原文摘要 · Abstract (English)
Expanding the receptive field in a deep learning model for large-scale 3D point cloud segmentation is an effective technique for capturing rich contextual information, which consequently enhances the network's ability to learn meaningful features. However, this often leads to increased computational complexity and risk of overfitting, challenging the efficiency and effectiveness of the learning paradigm. To address these limitations, we propose the Local Split Attention Pooling (LSAP) mechanism to effectively expand the receptive field through a series of local split operations, thus facilitating the acquisition of broader contextual knowledge. Concurrently, it optimizes the computational workload associated with attention-pooling layers to ensure a more streamlined processing workflow. Based on LSAP, a Parallel Aggregation Enhancement (PAE) module is introduced to enable parallel processing of data using both 2D and 3D neighboring information to further enhance contextual representations within the network. In light of the aforementioned designs, we put forth a novel framework, designated as LSNet, for large-scale point cloud semantic segmentation. Extensive evaluations demonstrated the efficacy of seamlessly integrating the proposed PAE module into existing frameworks, yielding significant improvements in mean intersection over union (mIoU) metrics, with a notable increase of up to 11%. Furthermore, LSNet demonstrated superior performance compared to state-of-the-art semantic segmentation networks on three benchmark datasets, including S3DIS, Toronto3D, and SensatUrban. It is noteworthy that our method achieved a substantial speedup of approximately 38.8% compared to those employing similar-sized receptive fields, which serves to highlight both its computational efficiency and practical utility in real-world large-scale scenes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。