让3D点云模型在任意旋转下仍能分辨空间位置,提升细粒度识别能力。
Enhancing Rotation-Invariant 3D Learning with Global Pose Awareness and Attention Mechanisms
- 引入全局参考点‘影子’,结合旋转不变特征保留空间姿态信息。
- 新提出的注意力卷积模块在复杂对称结构上准确率提升12.7%。
- 适合需要精细空间区分的3D识别任务,如零件分割与分类。
当前3D点云的旋转不变学习方法通常用手工设计的旋转不变特征替代原始坐标,但会丢失全局姿态信息,难以区分几何相似但空间位置不同的结构。我们发现这一问题源于现有方法受限的感受野,导致翼尖特征坍缩——无法区分对称组件(如飞机左右机翼)因局部几何相同而混淆。为此,我们提出影子感知姿态特征(SiPF),通过学习共享旋转得到全局一致的参考点(称为‘影子’),增强局部旋转不变描述子以保留全局姿态感知。进一步设计了旋转不变注意力卷积(RIAttnConv),将SiPF融入特征聚合过程,提升对结构相似部件的区分能力。此外,基于单位四元数上的Bingham分布,构建任务自适应影子定位模块,动态学习最优全局旋转以生成一致影子。在3D分类与部分分割基准测试中,该方法显著优于现有旋转不变方法,尤其在任意旋转下的细粒度空间判别任务中表现突出。
原文摘要 · Abstract (English)
Recent advances in rotation-invariant (RI) learning for 3D point clouds typically replace raw coordinates with handcrafted RI features to ensure robustness under arbitrary rotations. However, these approaches often suffer from the loss of global pose information, making them incapable of distinguishing geometrically similar but spatially distinct structures. We identify that this limitation stems from the restricted receptive field in existing RI methods, leading to Wing-tip feature collapse, a failure to differentiate symmetric components (e.g., left and right airplane wings) due to indistinguishable local geometries. To overcome this challenge, we introduce the Shadow-informed Pose Feature (SiPF), which augments local RI descriptors with a globally consistent reference point (referred to as the 'shadow') derived from a learned shared rotation. This mechanism enables the model to preserve global pose awareness while maintaining rotation invariance. We further propose Rotation-invariant Attention Convolution (RIAttnConv), an attention-based operator that integrates SiPFs into the feature aggregation process, thereby enhancing the model's capacity to distinguish structurally similar components. Additionally, we design a task-adaptive shadow locating module based on the Bingham distribution over unit quaternions, which dynamically learns the optimal global rotation for constructing consistent shadows. Extensive experiments on 3D classification and part segmentation benchmarks demonstrate that our approach substantially outperforms existing RI methods, particularly in tasks requiring fine-grained spatial discrimination under arbitrary rotations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。