arXiv:2605.28420cs.LG2026-05

提出统一框架,让模型学习类别间结构关系,提升复杂分类任务性能。

Conveyance: A Versatile Framework for Learning in Structured Class Spaces

论文配图:Conveyance: A Versatile Framework for Learning in Structured Class Spaces
图 1 · 摘自论文原文
  • 通过双边边界最大化,利用类别图结构优化分类损失
  • 在层级分类、序数回归等任务中超越或媲美专用方法
  • 无需手动调参或定义复杂分布,适合有类别关系的场景

尽管机器学习架构快速演进以处理复杂数据,但交叉熵等损失函数在实际应用中仍大多忽略类别结构。标准损失的“类对称性”从根本上限制了模型对类别间结构关系的利用,尤其在结构噪声下表现受限。本文提出Conveyance,一种面向结构化类别空间的新分类方法及对应损失函数。该方法可无需定义复杂联合分布或人工调节效用矩阵,直接编码类别间的图结构关系。技术上,其损失函数通过在不同类别划分上分别最大化两个独立边界,同时保持单调性和部分凸性等形式性质。我们在层次分类、序数回归和多实例学习任务中验证了该方法的通用性与有效性,结果表明Conveyance在各项任务中均达到或超过专用基线性能,为结构化类别空间提供了统一解决方案。

原文摘要 · Abstract (English)

While machine learning (ML) architectures have evolved rapidly to account for complex data, loss functions like cross-entropy remain mostly structure-agnostic in many real-world applications. However, the "class-symmetric" nature of these standard losses fundamentally limits the ability of ML models to exploit structural relationships between classes, particularly when facing structured noise. We propose Conveyance, a new classification approach and associated loss function tailored to structured class spaces. It allows users to encode graph-like relations between classes without having to define complex joint distributions or manually tune utility matrices. Technically, our loss function operates by maximizing two separate margins over distinct class partitions, while preserving formal properties such as monotonicity and partial convexity. We demonstrate the versatility and effectiveness of our method by applying it to hierarchical classification, ordinal regression, and multiple instance learning. Across these tasks, Conveyance either matches or exceeds the performance of specialized baselines, thereby offering a unified solution for structured class spaces.

结构分类损失函数类别关系统一框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。