利用层次结构提升分类精度,避免粗粒度与细粒度间的性能权衡。
Harnessing Superclasses for Learning from Hierarchical Databases
- 设计基于层次结构的损失函数,同时优化父类与子类分类结果。
- 在三个基准数据集上提升准确率,显著减少树结构中远距离标签错误。
- 兼容任意前馈网络,计算开销与交叉熵相当,适合大规模层级分类任务。
在许多大规模分类问题中,类别以已知层次结构组织,通常表示为树形结构,体现类与超类的包含关系。本文提出一种适用于此类监督层次分类的损失函数,利用层次知识使每个样本不仅被分配到具体类别,还被分配到所有包含它的超类。该损失适用于任何具有 softmax 输出层的前馈架构,是一种合理的评分规则,其期望值在真实后验概率下最小化。这一性质使得超类与细粒度类别的分类目标可同时一致优化,无需在不同粒度间做性能权衡。我们在三个参考基准上进行实验,通过调整训练集规模覆盖多样学习场景。所提方法相比交叉熵损失无显著额外计算成本,提升了分类准确率,并减少了预测标签与真实标签在树中距离较远的粗粒度错误。
原文摘要 · Abstract (English)
In many large-scale classification problems, classes are organized in a known hierarchy, typically represented as a tree expressing the inclusion of classes in superclasses. We introduce a loss for this type of supervised hierarchical classification. It utilizes the knowledge of the hierarchy to assign each example not only to a class but also to all encompassing superclasses. Applicable to any feedforward architecture with a softmax output layer, this loss is a proper scoring rule, in that its expectation is minimized by the true posterior class probabilities. This property allows us to simultaneously pursue consistent classification objectives between superclasses and fine-grained classes, and eliminates the need for a performance trade-off between different granularities. We conduct an experimental study on three reference benchmarks, in which we vary the size of the training sets to cover a diverse set of learning scenarios. Our approach does not entail any significant additional computational cost compared with the loss of cross-entropy. It improves accuracy and reduces the number of coarse errors, with predicted labels that are distant from ground-truth labels in the tree.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。