arXiv:2511.08077cs.LGcs.AI2025-11被引 15

融合梯度提升与模糊规则模型,提升性能与可解释性

An Integrated Fusion Framework for Ensemble Learning Leveraging Gradient Boosting and Fuzzy Rule-Based Models

  • 用动态因子控制每轮模糊规则模型的贡献
  • 显著降低过拟合,规则数量更少但效果更好
  • 适合需要可解释性又兼顾精度的场景

不同学习范式的融合是机器学习研究的重点,旨在克服单一方法的固有局限。模糊规则模型在可解释性方面表现优异,已广泛应用于多个领域,但存在设计复杂、大数据集下扩展性差等问题。本文提出一种集成融合框架,结合梯度提升与模糊规则模型的优势,以提升模型性能和可解释性。在每次迭代中,构建一个模糊规则模型,并通过动态因子控制其对整体集成的贡献。该因子兼具防主导、促多样性、正则化及基于性能动态调优功能,有效缓解过拟合风险。此外,框架引入基于样本的修正机制,根据验证集反馈进行自适应调整。实验结果表明,该梯度提升框架显著提升了模糊规则模型的性能,尤其在抑制过拟合和减少规则复杂度方面表现突出。通过最优因子调控各模型贡献,框架在保持可解释性的同时,提升了性能并简化了模型维护与更新。

原文摘要 · Abstract (English)

The integration of different learning paradigms has long been a focus of machine learning research, aimed at overcoming the inherent limitations of individual methods. Fuzzy rule-based models excel in interpretability and have seen widespread application across diverse fields. However, they face challenges such as complex design specifications and scalability issues with large datasets. The fusion of different techniques and strategies, particularly Gradient Boosting, with Fuzzy Rule-Based Models offers a robust solution to these challenges. This paper proposes an Integrated Fusion Framework that merges the strengths of both paradigms to enhance model performance and interpretability. At each iteration, a Fuzzy Rule-Based Model is constructed and controlled by a dynamic factor to optimize its contribution to the overall ensemble. This control factor serves multiple purposes: it prevents model dominance, encourages diversity, acts as a regularization parameter, and provides a mechanism for dynamic tuning based on model performance, thus mitigating the risk of overfitting. Additionally, the framework incorporates a sample-based correction mechanism that allows for adaptive adjustments based on feedback from a validation set. Experimental results substantiate the efficacy of the presented gradient boosting framework for fuzzy rule-based models, demonstrating performance enhancement, especially in terms of mitigating overfitting and complexity typically associated with many rules. By leveraging an optimal factor to govern the contribution of each model, the framework improves performance, maintains interpretability, and simplifies the maintenance and update of the models.

集成学习模糊系统梯度提升

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。