通过捕捉点云拓扑结构,提升仿真到真实场景的无监督识别性能。
Topology-Aware Modeling for Unsupervised Simulation-to-Reality Point Cloud Recognition
- 利用低频高频3D结构建模全局拓扑关系,增强特征鲁棒性。
- 在三个公开基准上均超越当前最佳方法,显著缩小仿真与真实差距。
- 适合做3D点云领域适应、尤其是无监督场景下的研究者使用。
从3D物体点集学习语义表示常受几何差异挑战,主要源于数据采集方式不同。通常训练数据由点模拟器生成,而测试数据则来自不同3D传感器,造成仿真到真实(Sim2Real)域差距,限制点分类器泛化能力。现有无监督域适应(UDA)技术难以应对该差距,因缺乏稳健的域无关描述符,无法有效捕捉全局拓扑信息,导致对源域有限语义模式过拟合。为此,我们提出一种新型拓扑感知建模(TAM)框架,用于物体点云的Sim2Real无监督域适应。该方法通过低级高频3D结构表征全局空间拓扑,并设计新颖自监督学习任务,建模局部几何特征间的拓扑关系。此外,提出一种结合跨域对比学习与自训练的先进策略,有效降低噪声伪标签影响,提升适应过程鲁棒性。在三个公开的Sim2Real基准上的实验验证了TAM框架的有效性,各项任务中均实现对当前最优方法的一致性提升。代码将开源于https://github.com/zou-longkun/TAG.git。
原文摘要 · Abstract (English)
Learning semantic representations from point sets of 3D object shapes is often challenged by significant geometric variations, primarily due to differences in data acquisition methods. Typically, training data is generated using point simulators, while testing data is collected with distinct 3D sensors, leading to a simulation-to-reality (Sim2Real) domain gap that limits the generalization ability of point classifiers. Current unsupervised domain adaptation (UDA) techniques struggle with this gap, as they often lack robust, domain-insensitive descriptors capable of capturing global topological information, resulting in overfitting to the limited semantic patterns of the source domain. To address this issue, we introduce a novel Topology-Aware Modeling (TAM) framework for Sim2Real UDA on object point clouds. Our approach mitigates the domain gap by leveraging global spatial topology, characterized by low-level, high-frequency 3D structures, and by modeling the topological relations of local geometric features through a novel self-supervised learning task. Additionally, we propose an advanced self-training strategy that combines cross-domain contrastive learning with self-training, effectively reducing the impact of noisy pseudo-labels and enhancing the robustness of the adaptation process. Experimental results on three public Sim2Real benchmarks validate the effectiveness of our TAM framework, showing consistent improvements over state-of-the-art methods across all evaluated tasks. The source code of this work will be available at https://github.com/zou-longkun/TAG.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。