arXiv:2608.21653cs.LGcs.CV2026-08

解决多任务学习中损失尺度差异导致权重失效的问题。

Bounded Precision-Geometry Scaling for Robust Multi-Task Learning under Loss Scale Mismatch

论文配图:Bounded Precision-Geometry Scaling for Robust Multi-Task Learning under Loss Scale Mismatch
图 1 · 摘自论文原文
  • 用有界逻辑斯蒂函数映射任务方差,解耦网络与权重优化。
  • 在损失放大1000倍时,主评分仅下降0.001,远优于对比方法。
  • 对批量大小和校准不敏感,适合实际部署的多任务场景。

多任务学习常面临损失量级相差数个数量级的问题,导致同方差不确定性加权性能严重下降。本文提出有界精度-几何缩放(BPGS)方法,通过有界逻辑斯蒂参数化将每个任务的对数方差映射至基于独立批次损失统计的锚点,并解耦网络优化与不确定性优化。其归一化任务权重在非退化损失尺度下对均匀缩放具有理论不变性。我们在合成压力测试及三个真实基准上评估:NYUv2密集预测、Yeast多标签分类和RF1多目标回归。在损失从×1到×1000的纯缩放下,BPGS宏评分由0.777降至0.778,而Kendall加权从0.780降至0.637;对Kendall权重ℓ₁归一化也无法弥补差距。在NYUv2上,BPGS取得最低深度绝对相对误差(0.223)、深度均方根误差(0.790)和总损失(1.891),优于包括Nash-MTL在内的所有对比方法。批量大小与校准敏感性分析显示变化极小,相对于Kendall的运行开销低于1%。在Yeast上取得最高微平均F1(0.616),在RF1上表现竞争,尽管PCGrad在均方误差和平均绝对误差上仍领先。结果表明,BPGS是同方差不确定性加权的稳健替代方案,尤其在损失尺度差异主导优化时效果显著。

原文摘要 · Abstract (English)

Multi-task learning often combines losses that span several orders of magnitude, causing homoscedastic uncertainty weighting to degrade severely. We propose Bounded Precision-Geometry Scaling (BPGS), a method that maps each task's log-variance through a bounded sigmoid parameterisation anchored to detached batch loss statistics, and decouples network optimisation from uncertainty optimisation. Its normalised task weights are provably invariant to uniform rescaling under non-degenerate loss scales. We evaluate BPGS on synthetic stress tests and three real-world benchmarks: NYUv2 dense prediction, Yeast multi-label classification, and RF1 multi-target regression. Under pure loss rescaling from $\times 1$ to $\times 1000$, its macro score changes from 0.777 to 0.778, whereas Kendall weighting drops from 0.780 to 0.637; $\ell_1$-normalising Kendall's weights does not close the gap. On NYUv2, BPGS records the lowest depth absolute relative error (0.223), depth RMSE (0.790), and total loss (1.891) among all compared methods, including Nash-MTL. Sensitivity studies on batch size and calibration show small variation across the tested ranges, and runtime overhead relative to Kendall is under 1%. BPGS posts the highest Yeast micro-F1 (0.616) and is competitive on RF1, though PCGrad leads RMSE and MAE there. These findings establish BPGS as a scale-robust alternative to homoscedastic uncertainty weighting, notably effective when loss-scale disparities dominate multi-task optimisation.

多任务学习损失缩放权重优化鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。