用扩散模型解决标签模糊问题,自动提炼真实标签。
Diffusion Disambiguation Models for Partial Label Learning
- 将标签生成视为逐步去噪过程,建模标签的随机生成机制。
- 在真实标签未标注时,仍能通过伪干净标签实现准确分类。
- 动态更新标签估计,适合标签不明确的现实场景。
从模糊标签中学习是实际机器学习应用中的长期难题。部分标签学习(PLL)旨在从与实例关联的一组候选标签中识别出真实标签。受扩散模型在各类生成任务中优异表现的启发,本文探索其通过逆向去噪过程对模糊标签进行去噪的潜力。因此,本文从生成模型视角重新构建标签消歧问题:标签通过迭代优化初始随机猜测生成。该视角使扩散模型能够学习标签信息的随机生成方式。通过建模生成不确定性,可使用标签的最大似然估计进行分类推理。然而,此类模糊标签导致实例与标签之间的不匹配,降低生成数据质量。为解决此问题,本文提出一种用于部分标签学习的扩散消歧模型(DDMP),首先利用实例与标签间的潜在互补信息构建伪干净标签以进行初始扩散训练;进一步引入一种转移感知矩阵,动态估计潜在真实标签,并在扩散生成过程中持续更新。训练期间,真实标签逐步被优化,从而提升分类器性能。实验表明,该方法在部分标签学习任务中具有优势。
原文摘要 · Abstract (English)
Learning from ambiguous labels is a long-standing problem in practical machine learning applications. The purpose of \emph{partial label learning} (PLL) is to identify the ground-truth label from a set of candidate labels associated with a given instance. Inspired by the remarkable performance of diffusion models in various generation tasks, this paper explores their potential to denoise ambiguous labels through the reverse denoising process. Therefore, this paper reformulates the label disambiguation problem from the perspective of generative models, where labels are generated by iteratively refining initial random guesses. This perspective enables the diffusion model to learn how label information is generated stochastically. By modeling the generation uncertainty, we can use the maximum likelihood estimate of the label for classification inference. However, such ambiguous labels lead to a mismatch between instance and label, which reduces the quality of generated data. To address this issue, this paper proposes a \emph{diffusion disambiguation model for PLL} (DDMP), which first uses the potential complementary information between instances and labels to construct pseudo-clean labels for initial diffusion training. Furthermore, a transition-aware matrix is introduced to estimate the potential ground-truth labels, which are dynamically updated during the diffusion generation. During training, the ground-truth label is progressively refined, improving the classifier. Experiments show the advantage of the DDMP and its suitability for PLL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。