arXiv:2503.18185cs.AIcs.LG2025-03被引 9

用物理能量模型找最小改动,让AI决策更透明可解释

Exploring Energy Landscapes for Minimal Counterfactual Explanations: Applications in Cybersecurity and Beyond

  • 将模型预测变化建模为能量最小化问题,用统计力学方法搜索最小微调
  • 在物联网安全数据集上验证,能生成可行动、可信的反事实解释
  • 适合需要理解模型决策边界的研究者和安全系统开发者

反事实解释已成为可解释人工智能(XAI)的重要方法,通过识别使模型预测发生变化的最小输入修改,提供贴近人类思维的‘如果……会怎样’分析。本文提出一种新框架,结合微扰理论与统计力学,将反事实搜索重构为复杂能量景观上的最小化问题。通过局部泰勒展开建模预测函数,并利用玻尔兹曼分布评估候选扰动概率,结合模拟退火进行迭代优化。该方法系统性地找到改变模型预测所需的最小且合理的修改。在物联网环境下的网络安全基准数据集上实验表明,该方法能生成可操作、可解释的反事实解释,深入揭示高维空间中模型对输入的敏感性和决策边界特性。

原文摘要 · Abstract (English)

Counterfactual explanations have emerged as a prominent method in Explainable Artificial Intelligence (XAI), providing intuitive and actionable insights into Machine Learning model decisions. In contrast to other traditional feature attribution methods that assess the importance of input variables, counterfactual explanations focus on identifying the minimal changes required to alter a model's prediction, offering a ``what-if'' analysis that is close to human reasoning. In the context of XAI, counterfactuals enhance transparency, trustworthiness and fairness, offering explanations that are not just interpretable but directly applicable in the decision-making processes. In this paper, we present a novel framework that integrates perturbation theory and statistical mechanics to generate minimal counterfactual explanations in explainable AI. We employ a local Taylor expansion of a Machine Learning model's predictive function and reformulate the counterfactual search as an energy minimization problem over a complex landscape. In sequence, we model the probability of candidate perturbations leveraging the Boltzmann distribution and use simulated annealing for iterative refinement. Our approach systematically identifies the smallest modifications required to change a model's prediction while maintaining plausibility. Experimental results on benchmark datasets for cybersecurity in Internet of Things environments, demonstrate that our method provides actionable, interpretable counterfactuals and offers deeper insights into model sensitivity and decision boundaries in high-dimensional spaces.

可解释AI反事实解释能量模型网络安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。