揭示分类器曲线的几何本质,统一理解ROC与PR曲线的内在关系。
On the Geometry of Receiver Operating Characteristic and Precision-Recall Curves
- 基于正负类得分分布函数的复合函数G,统一描述常见评估指标。
- 曲线形状反映分类器行为,可指导阈值选择与模型优化。
- 适用于需要校准、成本敏感或资源受限场景的模型部署。
我们研究二分类问题中接收者操作特征(ROC)和精确率-召回率(PR)曲线的几何特性。核心发现是,许多常用评估指标本质上仅依赖于复合函数 $G := F_p igcirc F_n^{-1}$,其中 $F_p(ullet)$ 与 $F_n(ullet)$ 分别为正类与负类的分类器得分的条件累积分布函数。该几何视角有助于选择工作点、理解决策阈值影响,并比较不同分类器性能。同时揭示了曲线形状与分类器行为的关系,提供面向特定应用场景与约束的客观优化工具。进一步探讨了分类器优势的条件,通过分析与数值示例展示了类别可分性与方差对ROC/PR几何的影响,并建立了正负类泄漏函数 $G(ullet)$ 与KL散度之间的联系。框架强调模型校准、成本敏感优化及实际容量限制下的工作点选择等实践考量,推动更明智的分类器部署与决策。
原文摘要 · Abstract (English)
We study the geometry of Receiver Operating Characteristic (ROC) and Precision-Recall (PR) curves in binary classification problems. The key finding is that many of the most commonly used binary classification metrics are merely functions of the composition function $G := F_p \circ F_n^{-1}$, where $F_p(\cdot)$ and $F_n(\cdot)$ are the class-conditional cumulative distribution functions of the classifier scores in the positive and negative classes, respectively. This geometric perspective facilitates the selection of operating points, understanding the effect of decision thresholds, and comparison between classifiers. It also helps explain how the shapes and geometry of ROC/PR curves reflect classifier behavior, providing objective tools for building classifiers optimized for specific applications with context-specific constraints. We further explore the conditions for classifier dominance, present analytical and numerical examples demonstrating the effects of class separability and variance on ROC and PR geometries, and derive a link between the positive-to-negative class leakage function $G(\cdot)$ and the Kullback-Leibler divergence. The framework highlights practical considerations, such as model calibration, cost-sensitive optimization, and operating point selection under real-world capacity constraints, enabling more informed approaches to classifier deployment and decision-making.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。