无需预训练即可启动自监督学习,实现图像聚类的即插即用。
An Adaptor for Triggering Semi-Supervised Learning to Out-of-Box Serve Deep Image Clustering
- 通过随机伪标签+实例级分类,从无标注数据中构建聚类标签。
- 在CIFAR-10上仅比使用真实标签的方法低1.33%准确率。
- 可直接接入现有方法,提升已有自监督聚类模型性能。
近期一些工作将自监督学习(SSL)技术融入深度聚类框架以提升图像聚类效果,但均需预训练或已训练聚类模型作为前提,限制了SSL学习器在图像聚类任务中的灵活、即插即用应用。本文提出ASD适配器,可在无任何先验条件下冷启动SSL学习器用于深度图像聚类。首先,从所有无标签数据中随机采样伪标签数据,并设置实例级分类器以学习具有语义对齐的实例级标签。利用实例级分类能力,追踪无标签数据预测的类别演化,提取实例级类别的高层次相似性,进而为伪标签数据分配聚类级标签。最后,使用带有聚类级标签的伪标签数据触发在无标签数据上训练的一般性SSL学习器进行图像聚类。实验表明,ASD在多个基准测试中表现优于最新深度图像聚类方法,且与使用真实标签的SSL方法相比仅存在微小精度差距(如CIFAR-10上仅1.33%)。此外,ASD还能进一步提升现有嵌入自监督的深度聚类方法性能。
原文摘要 · Abstract (English)
Recently, some works integrate SSL techniques into deep clustering frameworks to enhance image clustering performance. However, they all need pretraining, clustering learning, or a trained clustering model as prerequisites, limiting the flexible and out-of-box application of SSL learners in the image clustering task. This work introduces ASD, an adaptor that enables the cold-start of SSL learners for deep image clustering without any prerequisites. Specifically, we first randomly sample pseudo-labeled data from all unlabeled data, and set an instance-level classifier to learn them with semantically aligned instance-level labels. With the ability of instance-level classification, we track the class transitions of predictions on unlabeled data to extract high-level similarities of instance-level classes, which can be utilized to assign cluster-level labels to pseudo-labeled data. Finally, we use the pseudo-labeled data with assigned cluster-level labels to trigger a general SSL learner trained on the unlabeled data for image clustering. We show the superior performance of ASD across various benchmarks against the latest deep image clustering approaches and very slight accuracy gaps compared to SSL methods using ground-truth, e.g., only 1.33% on CIFAR-10. Moreover, ASD can also further boost the performance of existing SSL-embedded deep image clustering methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。