无需数据集,仅靠单个物体自监督学习3D对称性
A dataset-free approach for self-supervised learning of 3D reflectional symmetries
- 基于点的视觉相似性构建对称性特征,利用预训练图像模型提取点描述符
- 在无标签情况下实现超越有监督大模型的对称性检测性能
- 适合资源受限场景,特别适用于单件物体的对称性分析
本文提出一种无需依赖数据集的自监督学习方法,仅通过单一物体本身即可学习其3D反射对称性。我们假设物体的对称性可由其内在特征决定,从而避免训练时需要大规模标注数据。为此,设计了一种自监督学习策略,无需真实标签。核心思想是:对称点应具有相似的视觉外观。为此,利用基础图像模型提取的特征为每个点计算视觉描述符,使点云具备视觉感知能力,从而优化自监督模型。实验表明,该方法在未使用任何标注数据的情况下,性能超过在大型数据集上训练的现有模型,同时计算和数据需求极低,兼具高效与高精度。
原文摘要 · Abstract (English)
In this paper, we explore a self-supervised model that learns to detect the symmetry of a single object without requiring a dataset-relying solely on the input object itself. We hypothesize that the symmetry of an object can be determined by its intrinsic features, eliminating the need for large datasets during training. Additionally, we design a self-supervised learning strategy that removes the necessity of ground truth labels. These two key elements make our approach both effective and efficient, addressing the prohibitive costs associated with constructing large, labeled datasets for this task. The novelty of our method lies in computing features for each point on the object based on the idea that symmetric points should exhibit similar visual appearances. To achieve this, we leverage features extracted from a foundational image model to compute a visual descriptor for the points. This approach equips the point cloud with visual features that facilitate the optimization of our self-supervised model. Experimental results demonstrate that our method surpasses the state-of-the-art models trained on large datasets. Furthermore, our model is more efficient, effective, and operates with minimal computational and data resources.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。