arXiv:2511.09775cs.CRcs.AI2025-11被引 1

用熵正则化让AI解释更安全,防止泄露用户隐私

Privacy-Preserving Explainable AIoT Application via SHAP Entropy Regularization

  • 在训练中加入SHAP贡献分布的熵正则项,使特征影响更均匀
  • 实验显示隐私泄露降低,同时保持高精度和解释可靠性
  • 适合关注AIoT隐私安全的研究者与开发者

人工智能物联网(AIoT)在智能家居中的广泛应用,推动了对透明可解释机器学习模型的需求。为增强用户信任并符合监管要求,当前普遍采用如SHAP、LIME等后处理解释方法。然而,这些方法可能无意中暴露敏感用户属性与行为模式,带来新的隐私风险。为此,本文提出基于SHAP熵正则化的隐私保护方法,在训练中引入熵正则目标,惩罚低熵的SHAP attribution分布,促使特征贡献更均匀分布。我们构建了一套基于SHAP的隐私攻击工具,利用解释输出推断敏感信息。在基准智能家庭能耗数据集上,对比实验表明该方法显著降低隐私泄露,同时保持高预测精度与解释忠实度。本工作推动了安全可信的可解释AIoT技术发展。

原文摘要 · Abstract (English)

The widespread integration of Artificial Intelligence of Things (AIoT) in smart home environments has amplified the demand for transparent and interpretable machine learning models. To foster user trust and comply with emerging regulatory frameworks, the Explainable AI (XAI) methods, particularly post-hoc techniques such as SHapley Additive exPlanations (SHAP), and Local Interpretable Model-Agnostic Explanations (LIME), are widely employed to elucidate model behavior. However, recent studies have shown that these explanation methods can inadvertently expose sensitive user attributes and behavioral patterns, thereby introducing new privacy risks. To address these concerns, we propose a novel privacy-preserving approach based on SHAP entropy regularization to mitigate privacy leakage in explainable AIoT applications. Our method incorporates an entropy-based regularization objective that penalizes low-entropy SHAP attribution distributions during training, promoting a more uniform spread of feature contributions. To evaluate the effectiveness of our approach, we developed a suite of SHAP-based privacy attacks that strategically leverage model explanation outputs to infer sensitive information. We validate our method through comparative evaluations using these attacks alongside utility metrics on benchmark smart home energy consumption datasets. Experimental results demonstrate that SHAP entropy regularization substantially reduces privacy leakage compared to baseline models, while maintaining high predictive accuracy and faithful explanation fidelity. This work contributes to the development of privacy-preserving explainable AI techniques for secure and trustworthy AIoT applications.

可解释AI隐私保护AIoTSHAP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。