arXiv:2605.24969cs.LGcs.AI2026-05

提出新方法解决长尾识别中头尾类性能权衡问题

OSDTW: Optimal Shared Depth and Task Weighting for Long-Tailed Recognition

论文配图:OSDTW: Optimal Shared Depth and Task Weighting for Long-Tailed Recognition
图 1 · 摘自论文原文
  • 将识别任务分解为头类和尾类两个子任务,共享编码器并分别优化
  • 通过可计算的偏差-方差分解,精准选择共享深度和任务权重
  • 在多个标准数据集上显著优于现有强基线方法

长尾识别面临持续存在的头尾性能权衡:提升尾部类别表现常导致头部准确率下降并增加训练不稳定性。尽管重加权、解耦训练和多专家方法取得了良好效果,但关于头尾类别间表征共享程度及跨类别组监督权重的设计仍依赖启发式选择。本文提出OSDTW,一种基于任务分解的原理性框架,将原始单标签识别问题拆分为头任务与尾任务,采用共享编码器和任务特定解码器实现。为处理两类标签间的互斥性与统计依赖性,引入因子化模型,证明其基于KL散度的泛化误差可分解为任务独立项之和(加常数),从而获得明确的任务目标。进一步设计三阶段训练流程:先独立训练各任务以估计最优解与费希尔信息矩阵,再进行加权联合训练学习共享编码器,最后分支组装构建最终解耦模型。在块对角费希尔近似下,推导出期望泛化误差的二阶展开,分解为编码器方差、编码器偏差与解码器方差。该偏差-方差分解提供可计算代理,用于选择共享深度与任务权重,实现高效超参数搜索。在标准长尾基准测试上的实验表明,所提方法显著优于多种强基线。

原文摘要 · Abstract (English)

Long-tailed recognition suffers from a persistent head--tail trade-off: improving tail performance often degrades head accuracy and can increase training instability. Despite strong empirical results from re-weighting, decoupled training, and multi-expert methods, key design choices about representation sharing between head and tail classes and supervision weighting across class groups remain largely heuristic. In this work, we propose OSDTW, a principled task-decomposition framework that partitions the original single-label recognition problem into a head task and a tail task, implemented with a shared encoder and task-specific decoders. To handle the mutual exclusivity and statistical dependence between the two label groups, we introduce a factorized model and show that the resulting Kullback--Leibler divergence-based generalization error can be written as the sum of task-wise terms up to an additive constant, yielding a well-defined task-wise objective. We further develop a three-stage training pipeline: independent task training to estimate task-wise optima and the Fisher information matrix, weighted joint training to learn a shared encoder, and branch assembly to construct the final decoupled model. Under a block-diagonal Fisher approximation, we derive a computable second-order expansion of the expected generalization error, decomposing it into encoder variance, encoder bias, and decoder variance. This bias--variance decomposition provides a computable proxy to select the shared depth and task weights, enabling efficient hyper-parameter search. Experiments on standard long-tailed benchmarks demonstrate the effectiveness of the proposed approach over strong baselines.

长尾识别任务分解偏差-方差

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。