提出可复现的模型无关解释方法,提升AI决策透明度。
EVolutionary Independent DEtermiNistiC Explanation
- 基于数学理论构建确定性解释框架,不依赖具体模型
- 在新冠音频诊断中使精准率提升32%,AUC提高16%
- 适合医疗、语音分析等需高可信AI的场景
人工智能在医疗与工程领域的广泛应用要求理解其决策过程。现有可解释性方法常产生不一致结果,难以识别影响推理的关键信号。本文提出进化独立确定性解释(EVIDENCE)理论,一种无需依赖模型的确定性方法,用于从黑箱模型中提取关键信号。该理论基于严格的数学形式化,在多种数据集上验证,包括新冠音频诊断、帕金森病语音记录及乔治·察内塔基斯音乐分类数据集(GTZAN)。实验显示,将EVIDENCE筛选的频谱图输入50层冻结残差网络,新冠诊断正例精准率提升32%,曲线下面积(AUC)提高16%;帕金森病分类实现近乎完美的精确率与敏感度,宏平均F1得分达0.997;在GTZAN数据集上保持0.996的高AUC,证明其在特征筛选与分类准确性的有效性。EVIDENCE在几乎所有指标上均优于LIME、SHAP和GradCAM等主流XAI方法。结果表明,EVIDENCE不仅提升分类性能,还提供可重复、透明的解释机制,对推动真实场景中AI系统的可信性与实用性具有重要意义。
原文摘要 · Abstract (English)
The widespread use of artificial intelligence deep neural networks in fields such as medicine and engineering necessitates understanding their decision-making processes. Current explainability methods often produce inconsistent results and struggle to highlight essential signals influencing model inferences. This paper introduces the Evolutionary Independent Deterministic Explanation (EVIDENCE) theory, a novel approach offering a deterministic, model-independent method for extracting significant signals from black-box models. EVIDENCE theory, grounded in robust mathematical formalization, is validated through empirical tests on diverse datasets, including COVID-19 audio diagnostics, Parkinson's disease voice recordings, and the George Tzanetakis music classification dataset (GTZAN). Practical applications of EVIDENCE include improving diagnostic accuracy in healthcare and enhancing audio signal analysis. For instance, in the COVID-19 use case, EVIDENCE-filtered spectrograms fed into a frozen Residual Network with 50 layers improved precision by 32% for positive cases and increased the area under the curve (AUC) by 16% compared to baseline models. For Parkinson's disease classification, EVIDENCE achieved near-perfect precision and sensitivity, with a macro average F1-Score of 0.997. In the GTZAN, EVIDENCE maintained a high AUC of 0.996, demonstrating its efficacy in filtering relevant features for accurate genre classification. EVIDENCE outperformed other Explainable Artificial Intelligence (XAI) methods such as LIME, SHAP, and GradCAM in almost all metrics. These findings indicate that EVIDENCE not only improves classification accuracy but also provides a transparent and reproducible explanation mechanism, crucial for advancing the trustworthiness and applicability of AI systems in real-world settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。