提出新方法提升多视角图像半监督分类效果
A Re-node Self-training Approach for Deep Graph-based Semi-supervised Classification on Multi-view Image Data
- 融合多视图特征与图卷积网络,动态引入伪标签优化训练
- 通过调整边界样本权重解决图结构不平衡问题
- 适合处理标注少、多视角的图像分类任务
近年来,基于图的半监督学习和伪标签技术因其减少标注依赖而受到关注。伪标签利用未标注数据预测结果提升模型训练,而基于图的方法则适用于图结构数据。然而,图像缺乏清晰图结构,且多视角数据复杂性限制了传统方法效率,多视角图结构融合仍是挑战。本文提出多视角图像数据的重节点自训练图半监督学习方法(RSGSLM)。该方法在图卷积网络框架内:(i) 结合线性特征变换与多视图图融合;(ii) 动态将伪标签融入GCN损失函数以提升多视角分类性能;(iii) 通过调整类别边界附近有标签样本的权重纠正拓扑不平衡;(iv) 引入适用于所有样本的无监督平滑损失。该组合在保持计算高效的同时优化性能。在多个多视角图像基准数据集上的实验表明,RSGSLM在多视角半监督场景中优于现有方法。
原文摘要 · Abstract (English)
Recently, graph-based semi-supervised learning and pseudo-labeling have gained attention due to their effectiveness in reducing the need for extensive data annotations. Pseudo-labeling uses predictions from unlabeled data to improve model training, while graph-based methods are characterized by processing data represented as graphs. However, the lack of clear graph structures in images combined with the complexity of multi-view data limits the efficiency of traditional and existing techniques. Moreover, the integration of graph structures in multi-view data is still a challenge. In this paper, we propose Re-node Self-taught Graph-based Semi-supervised Learning for Multi-view Data (RSGSLM). Our method addresses these challenges by (i) combining linear feature transformation and multi-view graph fusion within a Graph Convolutional Network (GCN) framework, (ii) dynamically incorporating pseudo-labels into the GCN loss function to improve classification in multi-view data, and (iii) correcting topological imbalances by adjusting the weights of labeled samples near class boundaries. Additionally, (iv) we introduce an unsupervised smoothing loss applicable to all samples. This combination optimizes performance while maintaining computational efficiency. Experimental results on multi-view benchmark image datasets demonstrate that RSGSLM surpasses existing semi-supervised learning approaches in multi-view contexts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。