用图变分自编码器从众包噪声标签中自动提炼真实标签
Dual-Primal Graph VAEs for Noisy Label Aggregation
- 构建双向图结构,通过消息传递联合建模标注者与样本关系
- 在多个众包基准上达到当前最佳性能,无需伪标签或合成数据
- 可融合神经网络分类器的中间表示,提升测试时准确率
从噪声众包标签中推断真实标签是一个重要的理论与实际问题。基于神经网络的方法为经典贝叶斯模型提供了替代方案,后者需预先设定生成模型族。然而现有模型要么仍依赖简单生成模型,要么需要伪标签或合成数据训练聚合分类器。本文提出一种图变分自编码器架构,其中解码器在众包数据集的邻接图上使用GAT进行消息传递,编码器则在其对偶图上操作。将真实标签视为隐变量,实现无需独立分类器的无监督表征学习。实验表明,该模型在众包基准上达到最先进性能。进一步证明方法通用性:通过扩充原始众包图,引入在噪声标签上训练的神经网络分类器的表示,显著提升测试时分类性能。
原文摘要 · Abstract (English)
Inferring the ground-truth from noisy crowdsourced labels is an important theoretical and practical problem. Neural network-based methods offer an alternative to classical Bayesian models which require specifying a family of generative models used for inference. However, current models either still rely on fairly simple generative models for inference or require pseudo-labels or synthetic data to train the aggregate classifier. We propose a graph VAE architecture in which the decoder and encoder use GAT-based message passing on the adjacency graph of a crowdsourced dataset and its dual, respectively. The ground-truth labels are treated as latent variables, enabling unsupervised representation learning without needing to train a separate classifier. We show our model achieves state of the art performance on crowdsourcing benchmarks. We then demonstrate the generality of our approach by showing how the original crowdsourcing graph can be augmented to incorporate side information such as representations from neural network classifiers trained on the noisy labels to substantially boost their classification performance at test time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。