解决标签不规则缺失问题,提升多任务学习中部分标签的利用效率。
Dual-Label Learning With Irregularly Present Labels
- 构建双塔架构显式建模标签间相关性,实现信息交互。
- 训练时动态补全缺失标签,推理时联合求解双标签系统。
- 在标签缺失率达60%时仍保持稳定,最优提升9.6% F1-score。
在多任务学习中,样本标签常因实验限制出现不规则缺失,表现为全标签、部分标签或无标签。本文聚焦双标签学习任务,提出一种新型训练与推理框架——双标签学习(Dual-Label Learning, DLL)。DLL将问题建模为双函数系统,要求两个函数同时满足标准监督、结构对偶性和概率对偶性。其采用双塔模型架构,显式促进标签间信息交换,以最大化部分可用标签的效用。训练时将缺失标签作为前向传播的一部分进行补全;推理时将标签视为双变量方程组的未知数联合预测。理论分析证明了方法可行性,大量实验表明,通过显式建模标签相关性并最大化标签利用率,本方法相比基线模型在F1-score上最高提升9.6%,或在MAPE上降低10.2%。尤为突出的是,当标签缺失率高达60%时,仍保持稳健表现,且在低缺失率(低至10%)时优于基线。
原文摘要 · Abstract (English)
In multi-task learning, labels are often missing irregularly across samples, which can be fully labeled, partially labeled or unlabeled. The irregular label presence often appears in scientific studies due to experimental limitations. It triggers a demand for a new training and inference mechanism that could accommodate irregularly present labels and maximize their utility. This work focuses on the two-label learning task and proposes a novel training and inference framework, Dual-Label Learning (DLL). The DLL framework formulates the problem into a dual-function system, in which the two functions should simultaneously satisfy standard supervision, structural duality and probabilistic duality. DLL features a dual-tower model architecture that allows for explicit information exchange between labels, aimed at maximizing the utility of partially available labels. During training, missing labels are imputed as part of the forward propagation process, while during inference, labels are predicted jointly as unknowns of a bivariate system of equations. Our theoretical analysis guarantees the feasibility of DLL, and extensive experiments are conducted to verify that by explicitly modeling label correlation and maximizing label utility, our method makes consistently better prediction than baseline approaches by up to 9.6% gain in F1-score or 10.2% reduction in MAPE. Remarkably, DLL maintains robust performance at a label missing rate of up to 60%, achieving even better results than baseline approaches at lower missing rates down to only 10%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。