优化属性顺序可提升模糊粗糙规则归纳的可解释性与效率
Optimising the attribute order in Fuzzy Rough Rule Induction
- 通过优化属性顺序,改进模糊粗糙规则生成过程
- 减少少量属性后,平衡准确率和规则平均长度均提升
- 适合关注模型可解释性的研究者和应用开发者
可解释性是机器学习研究的下一个关键前沿。在追求透明模型(如规则归纳算法)而非黑箱模型(如随机森林或神经网络)的过程中,规则归纳方法具有天然优势。我们此前提出基于模糊粗糙集理论的FRRI算法,在准确率和规则数量上优于其他方法。FRRI利用模糊不可分辨关系将数据空间划分为模糊粒度,并组合成最小覆盖规则集。该关系通过贪心方式逐步移除属性构建。本文探讨属性顺序是否影响性能:结果表明,仅优化属性顺序无法提升多个指标;但在该步骤中结合模糊粗糙特征选择剔除少量属性,可显著改善平衡准确率和平均规则长度。
原文摘要 · Abstract (English)
Interpretability is the next pivotal frontier in machine learning research. In the pursuit of glass box models - as opposed to black box models, like random forests or neural networks - rule induction algorithms are a logical and promising avenue, as the rules can easily be understood by humans. In our previous work, we introduced FRRI, a novel rule induction algorithm based on fuzzy rough set theory. We demonstrated experimentally that FRRI outperformed other rule induction methods with regards to accuracy and number of rules. FRRI leverages a fuzzy indiscernibility relation to partition the data space into fuzzy granules, which are then combined into a minimal covering set of rules. This indiscernibility relation is constructed by removing attributes from rules in a greedy way. This raises the question: does the order of the attributes matter? In this paper, we show that optimising only the order of attributes using known methods from fuzzy rough set theory and classical machine learning does not improve the performance of FRRI on multiple metrics. However, removing a small number of attributes using fuzzy rough feature selection during this step positively affects balanced accuracy and the average rule length.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。