arXiv:2509.18139cs.LG2025-09

FOLD-SE在可解释性与性能间取得平衡,优于FOLD-R++和XGBoost。

Comparative Analysis of FOLD-SE vs. FOLD-R++ in Binary Classification and XGBoost in Multi-Category Classification

  • 采用规则集生成策略,提升模型可解释性。
  • 二分类中规则更少,多分类中精度更高、速度更快。
  • 适合需要透明决策的医疗、金融等场景。

近年来,对兼顾准确性、效率与可解释性的机器学习模型需求显著增长。传统模型如神经网络虽在复杂数据集上表现优异,但缺乏内部透明性。为此,新型基于规则的算法如FOLD-SE应运而生,能提供可解释的规则集。本研究比较了FOLD-SE与FOLD-R++在二分类中的表现,并评估其在多分类任务中与广泛使用的集成模型XGBoost的性能差异。假设认为,因FOLD-SE生成更紧凑的规则集,其在多分类中准确率和F1分数将平均下降3%以上,处理时间也更慢。实验以准确率、F1分数和处理时间为评估指标。结果显示,FOLD-SE在二分类中规则更少,尽管准确率略低、处理时间稍慢;而在多分类任务中,其精度更高、效率远超XGBoost,且规则清晰可读。结果表明,FOLD-SE在二分类与多分类任务中均表现更优,证明规则型方法可在保持高可解释性的同时实现良好性能,是黑箱模型的可行替代方案。

原文摘要 · Abstract (English)

Recently, the demand for Machine Learning (ML) models that can balance accuracy, efficiency, and interpreability has grown significantly. Traditionally, there has been a tradeoff between accuracy and explainability in predictive models, with models such as Neural Networks achieving high accuracy on complex datasets while sacrificing internal transparency. As such, new rule-based algorithms such as FOLD-SE have been developed that provide tangible justification for predictions in the form of interpretable rule sets. The primary objective of this study was to compare FOLD-SE and FOLD-R++, both rule-based classifiers, in binary classification and evaluate how FOLD-SE performs against XGBoost, a widely used ensemble classifier, when applied to multi-category classification. We hypothesized that because FOLD-SE can generate a condensed rule set in a more explainable manner, it would lose upwards of an average of 3 percent in accuracy and F1 score when compared with XGBoost and FOLD-R++ in multiclass and binary classification, respectively. The research used data collections for classification, with accuracy, F1 scores, and processing time as the primary performance measures. Outcomes show that FOLD-SE is superior to FOLD-R++ in terms of binary classification by offering fewer rules but losing a minor percentage of accuracy and efficiency in processing time; in tasks that involve multi-category classifications, FOLD-SE is more precise and far more efficient compared to XGBoost, in addition to generating a comprehensible rule set. The results point out that FOLD-SE is a better choice for both binary tasks and classifications with multiple categories. Therefore, these results demonstrate that rule-based approaches like FOLD-SE can bridge the gap between explainability and performance, highlighting their potential as viable alternatives to black-box models in diverse classification tasks.

可解释性规则模型分类任务FOLD-SE

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。