无监督图像分类新方法,用多头聚类与集成提升准确率。
Unsupervised Image Classification with Adaptive Nearest Neighbor Selection and Cluster Ensembles
- 多头聚类生成多样分组,再通过集成融合为统一结果。
- 在CIFAR10、CIFAR100和ImageNet上分别达99.3%、89%、70.4%准确率。
- 首个无监督方法在ImageNet上突破70%,适合自监督学习研究者。
无监督图像分类旨在将未标注图像分组为语义有意义的类别。早期方法在迭代框架中结合表示学习与聚类,但近年来大模型兴起使研究转向仅依赖聚类,跳过表示学习。本文提出「聚类集成图像分类」(ICCE),基于多头聚类框架,引入自适应最近邻选择与聚类集成策略。首先在冻结主干网络上训练多个聚类头,生成多样化图像分组;随后通过聚类集成技术将可能冲突的结果合并为统一共识聚类;最后利用共识聚类结果作为伪标签训练图像分类器。ICCE在十个图像分类基准上达到顶尖性能,在CIFAR10上取得99.3%准确率,CIFAR100为89%,ImageNet为70.4%,显著缩小与有监督方法的差距。据我们所知,ICCE是首个在ImageNet上无监督准确率超过70%的方法。
原文摘要 · Abstract (English)
Unsupervised image classification, or image clustering, aims to group unlabeled images into semantically meaningful categories. Early methods integrated representation learning and clustering within an iterative framework. However, the rise of foundational models have recently shifted focus solely to clustering, bypassing the representation learning step. In this work, we build upon a recent multi-head clustering approach by introducing adaptive nearest neighbor selection and cluster ensembling strategies to improve clustering performance. Our method, "Image Clustering through Cluster Ensembles" (ICCE), begins with a clustering stage, where we train multiple clustering heads on a frozen backbone, producing diverse image clusterings. We then employ a cluster ensembling technique to consolidate these potentially conflicting results into a unified consensus clustering. Finally, we train an image classifier using the consensus clustering result as pseudo-labels. ICCE achieves state-of-the-art performance on ten image classification benchmarks, achieving 99.3% accuracy on CIFAR10, 89% on CIFAR100, and 70.4% on ImageNet datasets, narrowing the performance gap with supervised methods. To the best of our knowledge, ICCE is the first fully unsupervised image classification method to exceed 70% accuracy on ImageNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。