用隐式网格建模标签不确定性,提升多义性识别准确率
Latent label distribution grid representation for modeling uncertainty
- 构建标签分布网格,用高斯向量表示标签间关系
- 通过低秩约束和 Tucker 重构降低噪声,生成更准标签分布
- 适用于标签不精确的多义性分类任务,尤其适合弱监督场景
尽管标签分布学习(LDL)在刻画实例多义性方面具有潜力,但标签分布标注的复杂性和高成本导致标签空间存在大量不准确信息。这些不准确标签使标签空间充满不确定性,进而误导 LDL 算法做出错误决策。为此,我们提出隐式标签分布网格(LLDG),以构建低噪声表示空间。具体而言,首先基于标签差异构建标签相关矩阵,再将矩阵中每个值扩展为服从高斯分布的向量,从而构建 LLDG 来建模标签空间的不确定性。最后,通过 LLDG-Mixer 重构该网格,生成更精确的标签分布。我们对网格施加定制化低秩策略,假设标签关系可能含噪,需借助 Tucker 重构技术进行降噪。此外,我们将 LLDG 的生成作为上游任务,用于物体分类评估。大量实验表明,该方法在多个基准上表现优异。
原文摘要 · Abstract (English)
Although \textbf{L}abel \textbf{D}istribution \textbf{L}earning (LDL) has promising representation capabilities for characterizing the polysemy of an instance, the complexity and high cost of the label distribution annotation lead to inexact in the construction of the label space. The existence of a large number of inexact labels generates a label space with uncertainty, which misleads the LDL algorithm to yield incorrect decisions. To alleviate this problem, we model the uncertainty of label distributions by constructing a \textbf{L}atent \textbf{L}abel \textbf{D}istribution \textbf{G}rid (LLDG) to form a low-noise representation space. Specifically, we first construct a label correlation matrix based on the differences between labels, and then expand each value of the matrix into a vector that obeys a Gaussian distribution, thus building a LLDG to model the uncertainty of the label space. Finally, the LLDG is reconstructed by the LLDG-Mixer to generate an accurate label distribution. Note that we enforce a customized low-rank scheme on this grid, which assumes that the label relations may be noisy and it needs to perform noise-reduction with the help of a Tucker reconstruction technique. Furthermore, we attempt to evaluate the effectiveness of the LLDG by considering its generation as an upstream task to achieve the classification of the objects. Extensive experimental results show that our approach performs competitively on several benchmarks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。