用空间序列化提升点云注册效率,融合Mamba与Transformer优势
MT-PCR: Hybrid Mamba-Transformer Network with Spatial Serialization for Point Cloud Registration
- 通过Z阶曲线序列化点云特征,增强空间局部性以适配Mamba
- 在多个基准上精度超越现有方法,显存和计算量降低超50%
- 适合需要高效高精度点云处理的机器人与3D重建场景
点云注册是3D计算机视觉与机器人领域的基础任务。现有基于学习的方法多依赖Transformer,但其二次复杂度限制了点云分辨率,导致信息丢失。相比之下,基于状态空间模型的Mamba具有线性复杂度和强长程建模能力,但直接应用于无序不规则的点云数据时表现不佳。为此,我们提出MT-PCR,首个融合Mamba与Transformer的点云注册框架。通过Z阶空间填充曲线对点云特征进行序列化,强化空间局部性,使Mamba能更好建模几何结构;同时移除Mamba中常见的顺序指示模块,进一步提升性能。序列化特征经优化的Mamba编码器处理后,再由Transformer模块进行特征精炼。大量实验表明,MT-PCR在多个基准上均优于基于Transformer及其他先进方法,在精度与效率上均有显著提升,显存占用和浮点运算量大幅下降。
原文摘要 · Abstract (English)
Point cloud registration (PCR) is a fundamental task in 3D computer vision and robotics. Most learning-based PCR methods rely on Transformer architectures, which suffer from quadratic computational complexity. This limitation restricts the resolution of point clouds that can be processed, inevitably leading to information loss. In contrast, Mamba, a recently proposed model based on state-space models, achieves linear computational complexity while maintaining strong long-range contextual modeling capabilities. However, directly applying Mamba to PCR tasks yields suboptimal performance due to the unordered and irregular nature of point cloud data. To address these challenges, we propose MT-PCR, the first point cloud registration framework that integrates Mamba and Transformer modules. Specifically, we serialize point cloud features using Z-order space-filling curves to enforce spatial locality, enabling Mamba to better model the geometric structure of the inputs. Additionally, we remove the order-indicator module commonly used in Mamba-based sequence modeling, leading to improved performance in our setting. The serialized features are then processed by an optimized Mamba encoder, followed by a Transformer-based feature refinement stage. Extensive experiments on multiple benchmarks demonstrate that MT-PCR outperforms Transformer-based and other state-of-the-art methods in both accuracy and efficiency, significantly reducing GPU memory usage and FLOPs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。