arXiv:2410.15374cs.LGcs.AI2024-10被引 5

用统计方法提升点云模型可解释性,让决策更透明安全。

Explainability of Point Cloud Neural Networks Using SMILE: Statistical Model-Agnostic Interpretability with Local Explanations

  • 基于ECDF距离改进LIME,增强对点云数据的局部解释能力。
  • 在多种参数下表现稳定,显著降低误差且提升解释可靠性。
  • 适用于自动驾驶等高安全场景,帮助发现数据偏差问题。

当前,可解释人工智能(XAI)在机器人和点云应用中的重要性日益凸显,因模型决策缺乏透明度可能带来重大安全隐患,尤其在自主系统中。本研究将SMILE——一种专为深度神经网络设计的新解释方法——应用于点云模型。SMILE在LIME基础上引入经验累积分布函数(ECDF)统计距离,使用Anderson-Darling距离时表现出更强的鲁棒性和可解释性。该方法在不同核宽、扰动数量和聚类配置下均实现更低的保真度损失与更高的R²得分,验证了其优越性能。研究还通过杰卡德指数开展稳定性分析,为点云模型解释性建立新基准。同时,发现分类任务中‘人’类别存在数据集偏差,强调在自动驾驶与机器人等关键应用中需更全面的数据集。结果表明,先进可解释模型潜力巨大,未来可探索替代代理模型与解释技术在点云数据中的应用。

原文摘要 · Abstract (English)

In today's world, the significance of explainable AI (XAI) is growing in robotics and point cloud applications, as the lack of transparency in decision-making can pose considerable safety risks, particularly in autonomous systems. As these technologies are integrated into real-world environments, ensuring that model decisions are interpretable and trustworthy is vital for operational reliability and safety assurance. This study explores the implementation of SMILE, a novel explainability method originally designed for deep neural networks, on point cloud-based models. SMILE builds on LIME by incorporating Empirical Cumulative Distribution Function (ECDF) statistical distances, offering enhanced robustness and interpretability, particularly when the Anderson-Darling distance is used. The approach demonstrates superior performance in terms of fidelity loss, R2 scores, and robustness across various kernel widths, perturbation numbers, and clustering configurations. Moreover, this study introduces a stability analysis for point cloud data using the Jaccard index, establishing a new benchmark and baseline for model stability in this field. The study further identifies dataset biases in the classification of the 'person' category, emphasizing the necessity for more comprehensive datasets in safety-critical applications like autonomous driving and robotics. The results underscore the potential of advanced explainability models and highlight areas for future research, including the application of alternative surrogate models and explainability techniques in point cloud data.

可解释AI点云处理模型解释自动驾驶

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。