arXiv:2607.04028cs.LGcs.AI2026-07

统一框架让各类分类评估指标计算变得一致且可推广。

A Unified Algebraic Framework for Classification Performance Evaluation

论文配图:A Unified Algebraic Framework for Classification Performance Evaluation
图 1 · 摘自论文原文
  • 用指示矩阵和三种聚合方式,统一处理多种分类场景的评估。
  • 微平均精度、召回率和F1在多分类中等同于准确率。
  • 揭示了指标设计背后的代数规律,适合算法研究者参考。

我们提出一个统一的代数框架,用于涵盖二分类、多分类、多标签、序数、层次化、代价敏感及软标签等多种分类性能评估场景。真实与预测标签以二值指示矩阵表示,三种聚合算子(全局、列向、行向)直接对应微平均、宏平均/加权平均、实例平均。任何基于混淆矩阵四类计数的二分类度量,均可通过替换算子推广至所有场景,无需针对每种度量重新推导。我们证明,度量能否正确扩展的结构特性可由原始公式推导得出。微平均等于分母加权宏平均,仅当度量为可分解(线性分式)时成立,这是一个代数上严格刻画的类别。对于软标签真值,仅凭t-范数公理即可证明乘积t-范数是唯一保持边际成员关系的选项。在多分类设置中,微平均精度、微平均召回率与微平均F1完全等同于准确率。此外,二分类中的偏倚不变性可无条件传递至多标签聚合,但在多分类中仅部分成立。对于分子线性、分母与预测无关的度量,最优决策阈值即为负向预测权重所占比例,揭示标准训练目标是否对齐该度量。在独热编码下,若某度量的零真正例值仍依赖于真正例,则其理论最小值非零,即使完全错误的分类器(如10类任务中零正确预测)也存在非平凡性能下界(例如标签准确率为0.8)。

原文摘要 · Abstract (English)

We propose a unified algebraic framework for classification performance evaluation covering binary, multiclass, multilabel, ordinal, hierarchical, cost-sensitive, and soft-label settings. Actual and predicted labels are represented as binary indicator matrices, where three aggregation operators (global, column-wise, row-wise) correspond directly to micro, macro/weighted, and exemplar averaging. Any binary measure expressed in terms of the four confusion-matrix counts extends to all these settings by substituting an operator, with no measure-specific derivation. We show that structural properties governing an extension are derivable from the binary formula. Micro-averaging equals denominator-weighted macro-averaging precisely for aggregation-decomposable (linear-fractional) measures, a strict class characterised algebraically. For soft ground truth, we prove from t-norm axioms alone that the product t-norm is the unique choice whose confusion counts preserve marginal memberships. In multiclass settings, micro-precision, micro-recall, and micro-F1 collapse identically onto accuracy. Furthermore, binary skew-invariance transfers unconditionally to multilabel aggregation, but only partially to multiclass problems. For measures with a linear numerator and prediction-independent denominator, the optimal decision threshold is the share of the numerator weight favouring a negative prediction, revealing when standard training targets the measure. Under one-hot multiclass encoding, a measure fails to attain its theoretical minimum whenever its zero-true-positive value still depends on true negatives, establishing non-trivial performance floors even for completely incorrect classifiers (e.g., zero correct predictions on 10 classes yields a label accuracy of 0.8).

分类评估代数框架多标签指标理论

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。