让点云模型自动适应任意旋转,提升跨域泛化能力
Rotation-Adaptive Point Cloud Domain Generalization via Intricate Orientation Learning
- 通过迭代优化困难旋转,构建复杂方向样本集
- 设计方向感知对比学习,实现旋转一致的特征提取
- 在多个基准上达到当前最优,适合3D视觉研究者
3D点云分析对不可预测的旋转具有脆弱性,如何实现面向方向的域泛化仍是开放难题。现有旋转增强方法难以有效提升跨域鲁棒性。本文提出一种旋转自适应的点云域泛化框架,利用复杂方向特性增强泛化能力。通过识别每类点云最困难的旋转,优化构建复杂方向样本集,并引入方向感知对比学习,结合方向一致性损失与边界分离损失,使模型学习到类别判别性强且旋转一致的特征。在多个3D跨域基准上的大量实验与消融研究证实,该方法在方向感知3D域泛化任务中达到当前最优性能。
原文摘要 · Abstract (English)
The vulnerability of 3D point cloud analysis to unpredictable rotations poses an open yet challenging problem: orientation-aware 3D domain generalization. Cross-domain robustness and adaptability of 3D representations are crucial but not easily achieved through rotation augmentation. Motivated by the inherent advantages of intricate orientations in enhancing generalizability, we propose an innovative rotation-adaptive domain generalization framework for 3D point cloud analysis. Our approach aims to alleviate orientational shifts by leveraging intricate samples in an iterative learning process. Specifically, we identify the most challenging rotation for each point cloud and construct an intricate orientation set by optimizing intricate orientations. Subsequently, we employ an orientation-aware contrastive learning framework that incorporates an orientation consistency loss and a margin separation loss, enabling effective learning of categorically discriminative and generalizable features with rotation consistency. Extensive experiments and ablations conducted on 3D cross-domain benchmarks firmly establish the state-of-the-art performance of our proposed approach in the context of orientation-aware 3D domain generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。