通过有意义的分割扰动,生成可解释的点云分类模型可视化结果。
XAI for Point Cloud Data using Perturbations based on Meaningful Segmentation
- 基于点云分割生成有意义的区域,设计新型点位移扰动机制。
- 扰动后点云不再影响分类结果,提升解释的可靠性。
- 解释结果直观易懂,适合需要可信AI决策的领域使用。
本文提出一种针对点云分类神经网络的新型基于分割的可解释人工智能(XAI)方法。作为该方法的核心组件,我们引入了一种新颖的点位移扰动机制,对点云数据施加扰动。随着人工智能在关键领域应用的快速增长,理解其决策过程变得尤为重要。本研究聚焦于解释点云分类模型的运作逻辑。现有解释方法的关键在于生成人类易于理解的解释,以辅助分析与决策。为此,我们利用点云分割模型生成解释,通过分割区域引入扰动并生成显著性图。所提点位移机制确保被扰动的点不再影响分类输出。与以往方法不同,本方法使用的分割区域具有语义意义,人类可直接理解。实验对比了传统聚类算法生成的解释,并通过具体输入案例分析表明,本方法能生成更符合人类认知的有意义解释。
原文摘要 · Abstract (English)
We propose a novel segmentation-based explainable artificial intelligence (XAI) method for neural networks working on point cloud classification. As one building block of this method, we propose a novel point-shifting mechanism to introduce perturbations in point cloud data. Recently, AI has seen an exponential growth. Hence, it is important to understand the decision-making process of AI algorithms when they are applied in critical areas. Our work focuses on explaining AI algorithms that classify point cloud data. An important aspect of the methods used for explaining AI algorithms is their ability to produce explanations that are easy for humans to understand. This allows them to analyze the AI algorithms better and make appropriate decisions based on that analysis. Therefore, in this work, we intend to generate meaningful explanations that can be easily interpreted by humans. The point cloud data we consider represents 3D objects such as cars, guitars, and laptops. We make use of point cloud segmentation models to generate explanations for the working of classification models. The segments are used to introduce perturbations into the input point cloud data and generate saliency maps. The perturbations are introduced using the novel point-shifting mechanism proposed in this work which ensures that the shifted points no longer influence the output of the classification algorithm. In contrast to previous methods, the segments used by our method are meaningful, i.e. humans can easily interpret the meaning of the segments. Thus, the benefit of our method over other methods is its ability to produce more meaningful saliency maps. We compare our method with the use of classical clustering algorithms to generate explanations. We also analyze the saliency maps generated for example inputs using our method to demonstrate the usefulness of the method in generating meaningful explanations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。