用少量标注数据实现3D指代分割,性能提升近9倍。
3DResT: A Strong Baseline for Semi-Supervised 3D Referring Expression Segmentation
- 通过教师学生一致性采样筛选优质伪标签,强化监督信号。
- 动态加权低质量伪标签,避免信息浪费,提升模型泛化能力。
- 仅需1%标注数据即达全监督8.34点mIoU提升,适合数据稀缺场景。
3D指代表达分割(3D-RES)通常需要大量实例级标注,成本高昂。半监督学习(SSL)通过结合少量标注数据与大量未标注数据,降低标注成本的同时提升性能。现有方法在3D-RES中依赖高置信度阈值过滤伪标签,导致部分有价值信息被丢弃,且仅将高质量伪标签作为辅助监督,限制了模型潜力。本文提出首个针对3D-RES的半监督学习框架——3DResT,包含两项创新:教师-学生一致性采样(TSCS)用于筛选并整合高质量伪标签以增强标注数据;质量驱动动态加权(QDW)则为低质量伪标签分配较低权重,保留其有用信息。在主流基准上实验表明,仅使用1%标注数据时,3DResT相比全监督方法获得8.34点mIoU提升,显著优于现有方法。
原文摘要 · Abstract (English)
3D Referring Expression Segmentation (3D-RES) typically requires extensive instance-level annotations, which are time-consuming and costly. Semi-supervised learning (SSL) mitigates this by using limited labeled data alongside abundant unlabeled data, improving performance while reducing annotation costs. SSL uses a teacher-student paradigm where teacher generates high-confidence-filtered pseudo-labels to guide student. However, in the context of 3D-RES, where each label corresponds to a single mask and labeled data is scarce, existing SSL methods treat high-quality pseudo-labels merely as auxiliary supervision, which limits the model's learning potential. The reliance on high-confidence thresholds for filtering often results in potentially valuable pseudo-labels being discarded, restricting the model's ability to leverage the abundant unlabeled data. Therefore, we identify two critical challenges in semi-supervised 3D-RES, namely, inefficient utilization of high-quality pseudo-labels and wastage of useful information from low-quality pseudo-labels. In this paper, we introduce the first semi-supervised learning framework for 3D-RES, presenting a robust baseline method named 3DResT. To address these challenges, we propose two novel designs called Teacher-Student Consistency-Based Sampling (TSCS) and Quality-Driven Dynamic Weighting (QDW). TSCS aids in the selection of high-quality pseudo-labels, integrating them into the labeled dataset to strengthen the labeled supervision signals. QDW preserves low-quality pseudo-labels by dynamically assigning them lower weights, allowing for the effective extraction of useful information rather than discarding them. Extensive experiments conducted on the widely used benchmark demonstrate the effectiveness of our method. Notably, with only 1% labeled data, 3DResT achieves an mIoU improvement of 8.34 points compared to the fully supervised method.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。