用SHAP值聚类引导模型学习隐含模式,提升预测性能。
FORCE: Feature-Oriented Representation with Clustering and Explanation
- 基于SHAP值聚类生成潜变量,指导网络训练
- 在心脏病数据上F1提升至0.80(原0.72)
- 适合需要可解释性与性能提升的工业场景
利用潜在未观测结构学习数据中的内在模式以提升预测模型准确率,已成为深度学习研究的活跃方向。现有方法多通过聚类原始特征来捕捉潜在结构,但这些信息常可被复杂模型隐式获得,导致收益有限。本文提出一种基于SHAP(Shapley Additive exPlanations)的监督深度学习框架FORCE,其在神经网络架构中分两阶段使用SHAP值:(i) 利用聚类后的SHAP值构建额外潜变量以指导模型训练;(ii) 基于潜信息启动注意力机制。该方法使网络获知未观测值对特征重要性的改变。在三个真实数据集上评估,结果表明,相比未引入潜变量和注意力框架的模型,FORCE显著提升整体性能(如心脏病存在性预测的F1分数由0.72升至0.80)。基于SHAP值的聚类分配与注意力机制有效增强了深层模型对潜在模式的学习能力与判别性能。
原文摘要 · Abstract (English)
Learning about underlying patterns in data using latent unobserved structures to improve the accuracy of predictive models has become an active avenue of deep learning research. Most approaches cluster the original features to capture certain latent structures. However, the information gained in the process can often be implicitly derived by sufficiently complex models. Thus, such approaches often provide minimal benefits. We propose a SHAP (Shapley Additive exPlanations) based supervised deep learning framework FORCE which relies on two-stage usage of SHAP values in the neural network architecture, (i) an additional latent feature to guide model training, based on clustering SHAP values, and (ii) initiating an attention mechanism within the architecture using latent information. This approach gives a neural network an indication about the effect of unobserved values that modify feature importance for an observation. The proposed framework is evaluated on three real life datasets. Our results demonstrate that FORCE led to dramatic improvements in overall performance as compared to networks that did not incorporate the latent feature and attention framework (e.g., F1 score for presence of heart disease 0.80 vs 0.72). Using cluster assignments and attention based on SHAP values guides deep learning, enhancing latent pattern learning and overall discriminative capability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。