TDEC通过融合Transformer与分布信息,提升图像聚类效果。
TDEC: Deep Embedded Image Clustering with Transformer and Distribution Information
- 引入Transformer模块捕捉全局依赖,生成更具区分性的特征
- 设计降维模块构建适合聚类的低维空间,提升聚类友好性
- 利用嵌入特征的分布信息提供可靠监督信号,增强模型鲁棒性
图像聚类是多媒体机器学习中的关键但具有挑战性的任务。近年来,深度学习与聚类结合的方法在高维图像数据上取得了优于传统方法的性能。然而,现有深度聚类方法通常忽视不同图像区域间全局感知场的信息融合,尤其对复杂图像而言。此外,学习到的特征在维度上往往不适应聚类,且仅依赖简单距离信息进行聚类。为此,我们提出一种深度嵌入图像聚类方法TDEC,首次联合考虑特征表示、维度偏好与鲁棒分配。具体地,引入Transformer构建新型T-Encoder模块,以捕捉全局依赖关系并学习判别性特征;同时采用降维模块构建有利于聚类的低维空间。此外,在聚类过程中考虑嵌入特征的分布信息,为联合训练提供可靠监督信号。所提方法具备更强鲁棒性,可灵活适应不同数据规模、聚类数量和上下文复杂度。更重要的是,TDEC在多个复杂数据集上的聚类性能显著优于近期竞争方法。大量实验表明其优越性。
原文摘要 · Abstract (English)
Image clustering is a crucial but challenging task in multimedia machine learning. Recently the combination of clustering with deep learning has achieved promising performance against conventional methods on high-dimensional image data. Unfortunately, existing deep clustering methods (DC) often ignore the importance of information fusion with a global perception field among different image regions on clustering images, especially complex ones. Additionally, the learned features are usually clustering-unfriendly in terms of dimensionality and are based only on simple distance information for the clustering. In this regard, we propose a deep embedded image clustering TDEC, which for the first time to our knowledge, jointly considers feature representation, dimensional preference, and robust assignment for image clustering. Specifically, we introduce the Transformer to form a novel module T-Encoder to learn discriminative features with global dependency while using the Dim-Reduction block to build a friendly low-dimensional space favoring clustering. Moreover, the distribution information of embedded features is considered in the clustering process to provide reliable supervised signals for joint training. Our method is robust and allows for more flexibility in data size, the number of clusters, and the context complexity. More importantly, the clustering performance of TDEC is much higher than recent competitors. Extensive experiments with state-of-the-art approaches on complex datasets show the superiority of TDEC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。