用新方法让3D分类模型更充分地利用无标签数据,1%标注数据达领先效果。
Improving 3D Semi-supervised Learning by Effectively Utilizing All Unlabelled Data
- 通过自适应增强高置信度无标签样本,提升其学习贡献。
- 在1%标注数据下性能提升11.2%,仅需10%标注即接近全监督效果。
- 适合资源有限但需高效利用大量无标签3D数据的研究者。
半监督学习(SSL)已在少量标注数据下有效学习3D表征方面展现出潜力,同时利用大量无标签数据。传统方法依赖为无标签数据预测伪标签并融入训练过程,但现有方法未能充分利用所有无标签样本,限制了性能上限。为此,本文提出AllMatch——一种新型基于SSL的3D分类框架,能有效利用全部无标签样本。该框架包含三个模块:(1) 自适应硬增强模块,对高置信度且损失值较低的无标签样本施加较难的增强,以增强其贡献;(2) 反向学习模块,通过学习“不学什么”进一步提升无标签数据利用率;(3) 对比学习模块,确保在有监督与无监督设置中均从所有样本中学习。在两个主流3D数据集上的全面实验表明,在仅使用1%标注数据时性能最高提升11.2%,显著超越当前最优方法。此外,仅需10%标注数据即可达到几乎与全监督学习(使用全部标注数据)相当的性能,证明其高效利用无标签数据的能力。代码已公开于:https://github.com/snehaputul/AllMatch。
原文摘要 · Abstract (English)
Semi-supervised learning (SSL) has shown its effectiveness in learning effective 3D representation from a small amount of labelled data while utilizing large unlabelled data. Traditional semi-supervised approaches rely on the fundamental concept of predicting pseudo-labels for unlabelled data and incorporating them into the learning process. However, we identify that the existing methods do not fully utilize all the unlabelled samples and consequently limit their potential performance. To address this issue, we propose AllMatch, a novel SSL-based 3D classification framework that effectively utilizes all the unlabelled samples. AllMatch comprises three modules: (1) an adaptive hard augmentation module that applies relatively hard augmentations to the high-confident unlabelled samples with lower loss values, thereby enhancing the contribution of such samples, (2) an inverse learning module that further improves the utilization of unlabelled data by learning what not to learn, and (3) a contrastive learning module that ensures learning from all the samples in both supervised and unsupervised settings. Comprehensive experiments on two popular 3D datasets demonstrate a performance improvement of up to 11.2% with 1% labelled data, surpassing the SOTA by a significant margin. Furthermore, AllMatch exhibits its efficiency in effectively leveraging all the unlabelled data, demonstrated by the fact that only 10% of labelled data reaches nearly the same performance as fully-supervised learning with all labelled data. The code of our work is available at: https://github.com/snehaputul/AllMatch.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。