arXiv:2409.07931cs.CV2024-09被引 4

用跨视图补全网络解决多视图数据缺失的多标签分类问题

Task-Augmented Cross-View Imputation Network for Partial Multi-View Incomplete Multi-Label Classification

  • 分两阶段:先提取任务相关特征,再用自编码器补全缺失视图
  • 在5个数据集上表现优于现有方法,提升分类准确率
  • 适合处理标注不全、视图缺失的真实场景多标签任务

现实场景中,多视图多标签学习常因数据收集受限和标注不可靠导致训练数据不完整。视图缺失会削弱对样本的全面理解,遗漏关键分类信息。为此,我们提出任务增强的跨视图补全网络(TACVI-Net),用于处理部分多视图不完全多标签分类问题。具体地,采用两阶段网络:第一阶段基于信息瓶颈理论,通过视图专用编码器-分类器架构提取各视图的任务相关特征;第二阶段利用基于自编码器的多视图重构网络,提取增强特征的高层语义表示并恢复缺失数据,从而辅助最终分类。在五个数据集上的大量实验表明,TACVI-Net优于其他先进方法。

原文摘要 · Abstract (English)

In real-world scenarios, multi-view multi-label learning often encounters the challenge of incomplete training data due to limitations in data collection and unreliable annotation processes. The absence of multi-view features impairs the comprehensive understanding of samples, omitting crucial details essential for classification. To address this issue, we present a task-augmented cross-view imputation network (TACVI-Net) for the purpose of handling partial multi-view incomplete multi-label classification. Specifically, we employ a two-stage network to derive highly task-relevant features to recover the missing views. In the first stage, we leverage the information bottleneck theory to obtain a discriminative representation of each view by extracting task-relevant information through a view-specific encoder-classifier architecture. In the second stage, an autoencoder based multi-view reconstruction network is utilized to extract high-level semantic representation of the augmented features and recover the missing data, thereby aiding the final classification task. Extensive experiments on five datasets demonstrate that our TACVI-Net outperforms other state-of-the-art methods.

多视图学习多标签分类数据补全深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。