用交互式图表帮开发者理解分类模型评估指标的权衡关系
Interactive Classification Metrics: A graphical application to build robust intuition for classification model evaluation
- 通过动态调整数据分布，实时观察各类评估指标变化
- 揭示常见评估指标在不同场景下的局限性与偏差
- 适合刚入门机器学习的从业者快速建立评估直觉
机器学习在学术界、工业界及其他领域日益普及。然而，许多用于评估简单二分类模型的常用指标存在不足，这些缺陷既不明显也不常被从业者传授。本文提出交互式分类评估指标（Interactive Classification Metrics, ICM）工具，通过图形化界面展示不同评估指标之间的关系。用户可动态调整数据分布统计量，并观察相应指标的变化。该工具的交互式特性强调了各指标间的权衡，无需复杂的数据处理或模型训练。目标是帮助机器学习从业者选择最适合其任务的评估指标，并提升对简单场景下评估解释的审慎意识。该工具以MIT许可证开源，可在PyPI和GitHub免费获取。
原文摘要 · Abstract (English)
Machine learning continues to grow in popularity in academia, in industry, and is increasingly used in other fields. However, most of the common metrics used to evaluate even simple binary classification models have shortcomings that are neither immediately obvious nor consistently taught to practitioners. Here we present Interactive Classification Metrics (ICM), an application to visualize and explore the relationships between different evaluation metrics. The user changes the distribution statistics and explores corresponding changes across a suite of evaluation metrics. The interactive, graphical nature of this tool emphasizes the tradeoffs of each metric without the overhead of data wrangling and model training. The goals of this application are: (1) to aid practitioners in the ever-expanding machine learning field to choose the most appropriate evaluation metrics for their classification problem; (2) to promote careful attention to interpretation that is required even in the simplest scenarios like binary classification. Our application is publicly available for free under the MIT license as a Python package on PyPI at https://pypi.org/project/interactive-classification-metrics and on GitHub at https://github.com/davhbrown/interactive_classification_metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。