用无泄露堆叠法融合函数与规则模型,提升多分类准确率
A Leakage-Free Stacked Ensemble Method for Multiclass Classification

- 通过严格留外堆叠生成无偏元特征,防止数据泄露
- 在识别主要家族时准确率达89.85%,子家族达81.74%
- 适合需要高可靠性和泛化能力的结构化数据多分类任务
多分类是众多领域中的基础问题,仍面临类间相似度高、类别不平衡及数据分布变化等挑战。基于规则的分类器如XGBoost在结构化特征上表现优异,但难以捕捉变量间的平滑关系;神经网络可建模复杂非线性交互,却常出现过拟合与泛化问题。为此,本文提出LFS-FRAME——一种基于柯尔莫哥洛夫-阿诺德网络(KAN)的函数学习与XGBoost规则学习融合的无泄露堆叠集成框架。该框架采用严格的留外堆叠策略,确保训练与验证数据完全隔离,生成无偏元特征。通过学习异构基模型的概率输出,元分类器有效利用全局函数模式与尖锐决策边界。在多个多分类数据集上的实验表明,相较强单模型基线,整体准确率在识别主要家族时达89.85%,子家族达81.74%,验证了该方法在可靠与泛化多分类中的有效性。
原文摘要 · Abstract (English)
Multiclass classification is a fundamental problem across a wide range of domains. It is still challenging due to possession of high inter-class similarity, class imbalance datasets, and variability in data distributions. Rule-based classifiers such as XGBoost often achieve stronger performance on structured features, but they are limited in capturing smooth functional relationships among variables. Similarly, neural network models can represent complex nonlinear interactions but frequently suffer from overfitting and generalization issues. To address these limitations, we propose LFS-FRAME, a Leakage-Free Stacked ensemble framework that integrates functional learning using Kolmogorov-Arnold Networks (KAN) and rule-based learning via XGBoost for robust multiclass classification. The proposed framework constructs unbiased meta-features by employing a strict out-of-fold stacking strategy to ensure complete isolation between training and validation data hence preventing performance leakage. By learning over probabilistic outputs from heterogeneous base learners, the meta-classifier effectively exploits both global functional patterns and sharp decision boundaries present in the complex data. Experimental evaluations on multi-class datasets demonstrate that LFS-FRAME improves performance metrics, and overall accuracy is 89.85% in identifying major families and 81.74% in identifying sub-families relative to strong single-model baselines. These results highlight the effectiveness of leakage-free functional and rule-based stacking for reliable and generalizable multiclass classification.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。