让辅助任务与主任务平等训练,提升模型性能
Unprejudiced Training Auxiliary Tasks Makes Primary Better: A Multi-Task Learning Perspective
- 基于不确定性实现各任务均衡训练,避免辅助任务被弱化
- 在多种设置下显著提升主任务表现,尤其对噪声标签鲁棒
- 适合需要多任务协同优化的深度学习场景
人类能通过相关任务的知识提升主任务的学习效果。类似地,多任务学习方法也利用辅助任务来增强神经网络在特定主任务上的表现。然而,以往方法通常精心挑选辅助任务,但在训练中将其视为次要,且辅助损失权重普遍低于主任务,导致辅助任务训练不足,难以有效支持主任务。为此,我们提出一种基于不确定性的无偏学习方法,确保所有任务获得均衡训练。同时,在反向传播中融合梯度与不确定性信息,进一步提升主任务性能。大量实验表明,该方法性能可达到或超过当前最优水平。此外,其权重策略在面对带噪声的辅助任务伪标签时仍具有效性和鲁棒性。
原文摘要 · Abstract (English)
Human beings can leverage knowledge from relative tasks to improve learning on a primary task. Similarly, multi-task learning methods suggest using auxiliary tasks to enhance a neural network's performance on a specific primary task. However, previous methods often select auxiliary tasks carefully but treat them as secondary during training. The weights assigned to auxiliary losses are typically smaller than the primary loss weight, leading to insufficient training on auxiliary tasks and ultimately failing to support the main task effectively. To address this issue, we propose an uncertainty-based impartial learning method that ensures balanced training across all tasks. Additionally, we consider both gradients and uncertainty information during backpropagation to further improve performance on the primary task. Extensive experiments show that our method achieves performance comparable to or better than state-of-the-art approaches. Moreover, our weighting strategy is effective and robust in enhancing the performance of the primary task regardless the noise auxiliary tasks' pseudo labels.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。