用可解释的模糊规则建模,让深度学习既准确又透明。
Fuzzy Rule-based Differentiable Representation Learning
- 基于TSK模糊系统构建可解释的高维特征空间。
- 提出可微优化方法,保持模型透明性同时捕捉非线性关系。
- 适合需要模型可解释性的工业场景,如医疗、金融风控。
表示学习在机器与深度学习中日益重要,旨在从输入数据中提取有意义的特征以提升分类、聚类和预测等下游任务性能。当前主流方法多依赖核方法或深度神经网络等非线性技术,但普遍存在黑箱问题,缺乏过程可解释性,限制了实际应用。本文提出一种基于可解释模糊规则的新型表示学习方法,以Takagi-Sugeno-Kang模糊系统(TSK-FS)为基础,通过其前提部分将输入数据映射至高维模糊特征空间。针对结论部分学习,设计了一种新型可微优化方法,通过参数化可微模块实现深层优化,既保留传统优化本质,又增强对数据非线性关系的挖掘能力。此外,引入二阶几何保形方法进一步提升模型鲁棒性。在多个基准数据集上的大量实验验证了该方法的优越性,展现了其在推进表示学习方法方面的潜力。
原文摘要 · Abstract (English)
Representation learning has emerged as a crucial focus in machine and deep learning, involving the extraction of meaningful and useful features and patterns from the input data, thereby enhancing the performance of various downstream tasks such as classification, clustering, and prediction. Current mainstream representation learning methods primarily rely on non-linear data mining techniques such as kernel methods and deep neural networks to extract abstract knowledge from complex datasets. However, most of these methods are black-box, lacking transparency and interpretability in the learning process, which constrains their practical utility. To this end, this paper introduces a novel representation learning method grounded in an interpretable fuzzy rule-based model. Specifically, it is built upon the Takagi-Sugeno-Kang fuzzy system (TSK-FS) to initially map input data to a high-dimensional fuzzy feature space through the antecedent part of the TSK-FS. Subsequently, a novel differentiable optimization method is proposed for the consequence part learning which can preserve the model's interpretability and transparency while further exploring the nonlinear relationships within the data. This optimization method retains the essence of traditional optimization, with certain parts of the process parameterized corresponding differentiable modules constructed, and a deep optimization process implemented. Consequently, this method not only enhances the model's performance but also ensures its interpretability. Moreover, a second-order geometry preservation method is introduced to further improve the robustness of the proposed method. Extensive experiments conducted on various benchmark datasets validate the superiority of the proposed method, highlighting its potential for advancing representation learning methodologies.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。