提出共享码本与融合教师自蒸馏,解决视图和标签双重缺失的多视图多标签分类问题。
Incomplete Multi-View Multi-Label Classification via Shared Codebook and Fused-Teacher Self-Distillation
- 用共享码本学习离散一致表征,跨视图重建实现结构化对齐。
- 在五个数据集上超越先进方法,融合预测准确率提升显著。
- 适合处理视图或标签不全场景,尤其适用于医疗、图像分析等复杂任务。
尽管多视图多标签学习已得到广泛研究,但视图和标签均不完整这一双重缺失场景仍鲜有探索。现有方法多依赖对比学习或信息瓶颈理论,在缺失视图条件下学习一致表征,但基于损失的对齐缺乏显式结构约束,难以捕捉稳定且判别性强的共享语义。为此,我们引入更结构化的机制:通过多视图共享码本与跨视图重建,学习离散的一致表征,自然对齐不同视图的嵌入,并减少特征冗余。在决策层面,设计权重估计方法评估各视图保留标签相关结构的能力,动态分配权重以提升融合预测质量。此外,提出融合教师自蒸馏框架,由融合预测指导视图特异性分类器训练,并将全局知识反馈至单视图分支,增强模型在缺失标签条件下的泛化能力。所提方法在五个基准数据集上的大量对比实验中验证了有效性。代码已公开于 https://github.com/xuy11/SCSD。
原文摘要 · Abstract (English)
Although multi-view multi-label learning has been extensively studied, research on the dual-missing scenario, where both views and labels are incomplete, remains largely unexplored. Existing methods mainly rely on contrastive learning or information bottleneck theory to learn consistent representations under missing-view conditions, but loss-based alignment without explicit structural constraints limits the ability to capture stable and discriminative shared semantics. To address this issue, we introduce a more structured mechanism for consistent representation learning: we learn discrete consistent representations through a multi-view shared codebook and cross-view reconstruction, which naturally align different views within the limited shared codebook embeddings and reduce feature redundancy. At the decision level, we design a weight estimation method that evaluates the ability of each view to preserve label correlation structures, assigning weights accordingly to enhance the quality of the fused prediction. In addition, we introduce a fused-teacher self-distillation framework, where the fused prediction guides the training of view-specific classifiers and feeds the global knowledge back into the single-view branches, thereby enhancing the generalization ability of the model under missing-label conditions. The effectiveness of our proposed method is thoroughly demonstrated through extensive comparative experiments with advanced methods on five benchmark datasets. Code is available at https://github.com/xuy11/SCSD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。