arXiv:2604.21252cs.LG2026-04

LCEN算法拓展至分类任务,兼具高精度与特征可解释性。

Improving Performance in Classification Tasks with LCEN and the Weighted Focal Differentiable MCC Loss

  • 改进LCEN算法用于分类,保持稀疏性与可解释性
  • 在4个数据集上平均降低56%特征数,提升宏F1和MCC指标
  • 结合diffMCC损失函数,性能优于加权交叉熵

LASSO-Clip-EN(LCEN)算法此前用于非线性可解释特征选择与机器学习,但仅限回归任务。本文提出适用于分类任务的改进版LCEN,保留其可解释性等优势。在四个常用二分类与多分类数据集上评估,相比10种其他模型,LCEN始终取得更高测试集宏F1与马修斯相关系数(MCC)。实验中,LCEN模型平均剔除56%输入特征,仍保持高精度。使用其选中的特征重训模型,在三个实验中显著提升性能,第四个无显著差异。同时,提出的加权焦点可微分MCC(diffMCC)损失函数在所有数据集上表现最优,平均使宏F1提升4.9%,MCC提升8.5%,优于加权交叉熵损失。结果表明LCEN在分类任务中有效,且diffMCC能训练出更精准模型。

原文摘要 · Abstract (English)

The LASSO-Clip-EN (LCEN) algorithm was previously introduced for nonlinear, interpretable feature selection and machine learning. However, its design and use was limited to regression tasks. In this work, we create a modified version of the LCEN algorithm that is suitable for classification tasks and maintains its desirable properties, such as interpretability. This modified LCEN algorithm is evaluated on four widely used binary and multiclass classification datasets. In these experiments, LCEN is compared against 10 other model types and consistently reaches high test-set macro F$_1$ score and Matthews correlation coefficient (MCC) metrics, higher than that of the majority of investigated models. LCEN models for classification remain sparse, eliminating an average of 56% of all input features in the experiments performed. Furthermore, LCEN-selected features are used to retrain all models using the same data, leading to statistically significant performance improvements in three of the experiments and insignificant differences in the fourth when compared to using all features or other feature selection methods. Simultaneously, the weighted focal differentiable MCC (diffMCC) loss function is evaluated on the same datasets. Models trained with the diffMCC loss function are always the best-performing methods in these experiments, and reach test-set macro F$_1$ scores that are, on average, 4.9% higher and MCCs that are 8.5% higher than those obtained by models trained with the weighted cross-entropy loss. These results highlight the performance of LCEN as a feature selection and machine learning algorithm also for classification tasks, and how the diffMCC loss function can train very accurate models, surpassing the weighted cross-entropy loss in the tasks investigated.

特征选择分类模型MCC损失可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。