提出可解释模型应取代黑箱模型,提升可信度与性能。
Investigating the Duality of Interpretability and Explainability in Machine Learning
- 将符号知识融入神经网络,构建可解释的混合学习模型
- 实验验证混合模型在多领域可替代传统黑箱模型
- 强调从设计之初就追求可解释性,而非事后解释
机器学习的快速发展催生了深度神经网络等复杂“黑箱”模型的广泛应用,这些模型虽预测性能优异,但其不透明性引发对透明度与可解释性的担忧,阻碍其在关键决策领域的采纳。当前研究多聚焦于事后解释黑箱模型,而非从源头设计可解释模型。本文阐明解释黑箱与采用内在可解释模型之间的鸿沟,强调模型可解释性的必要性,并通过实验评估最新融合符号知识的混合学习方法,展示可解释混合模型在不同领域潜在取代黑箱模型的能力,以实现更高效、可信的预测系统。
原文摘要 · Abstract (English)
The rapid evolution of machine learning (ML) has led to the widespread adoption of complex "black box" models, such as deep neural networks and ensemble methods. These models exhibit exceptional predictive performance, making them invaluable for critical decision-making across diverse domains within society. However, their inherently opaque nature raises concerns about transparency and interpretability, making them untrustworthy decision support systems. To alleviate such a barrier to high-stakes adoption, research community focus has been on developing methods to explain black box models as a means to address the challenges they pose. Efforts are focused on explaining these models instead of developing ones that are inherently interpretable. Designing inherently interpretable models from the outset, however, can pave the path towards responsible and beneficial applications in the field of ML. In this position paper, we clarify the chasm between explaining black boxes and adopting inherently interpretable models. We emphasize the imperative need for model interpretability and, following the purpose of attaining better (i.e., more effective or efficient w.r.t. predictive performance) and trustworthy predictors, provide an experimental evaluation of latest hybrid learning methods that integrates symbolic knowledge into neural network predictors. We demonstrate how interpretable hybrid models could potentially supplant black box ones in different domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。