arXiv:2512.13689cs.CV2025-12被引 21

轻量级3D点云模型,用卷积+注意力混合设计提升效率与性能。

LitePT: Lighter Yet Stronger Point Transformer

  • 早期用卷积提取局部几何,后期切换注意力捕捉高层语义。
  • 参数减少3.6倍,速度提升2倍,内存降低2倍,性能不降反升。
  • 适合资源受限场景下的3D点云处理,如移动端或实时系统。

当前3D点云神经网络通常包含卷积层和注意力模块,但如何有效组合尚不明确。我们分析不同计算模块的作用发现:在浅层高分辨率阶段,卷积足以提取低层次几何特征,而注意力开销大且无益;在深层低分辨率阶段,注意力能更高效地捕捉高层次语义与上下文,而卷积则导致参数膨胀。基于此设计原则,我们提出LitePT,一种新型3D点云骨干网络,在早期阶段使用卷积,深层转为注意力。为避免舍弃冗余卷积层时丢失空间布局信息,引入一种无参数的3D位置编码——PointROPE。LitePT相比最先进的Point Transformer V3,参数减少3.6倍,运行速度提升2倍,内存占用降低2倍,同时在多个任务与数据集上表现相当或更优。代码与模型已开源。

原文摘要 · Abstract (English)

Modern neural architectures for 3D point cloud processing contain both convolutional layers and attention blocks, but the best way to assemble them remains unclear. We analyse the role of different computational blocks in 3D point cloud networks and find an intuitive behaviour: convolution is adequate to extract low-level geometry at high-resolution in early layers, where attention is expensive without bringing any benefits; attention captures high-level semantics and context in low-resolution, deep layers more efficiently, where convolution inflates the parameter count. Guided by this design principle, we propose a new, improved 3D point cloud backbone that employs convolutions in early stages and switches to attention for deeper layers. To avoid the loss of spatial layout information when discarding redundant convolution layers, we introduce a novel, parameter-free 3D positional encoding, PointROPE. The resulting LitePT model has $3.6\times$ fewer parameters, runs $2\times$ faster, and uses $2\times$ less memory than the state-of-the-art Point Transformer V3, but nonetheless matches or outperforms it on a range of tasks and datasets. Code and models are available at: https://github.com/prs-eth/LitePT.

点云处理轻量化注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。