用可解释AI选出关键参数,高效防护深度网络位翻转故障。
Efficient Triple Modular Redundancy for Reliability Enhancement of DNNs Using Explainable AI
- 用梯度法LPR计算神经元权重重要性,指导冗余保护范围。
- 在10^-4位错误率下,AlexNet可靠性提升超60%,开销与顶尖方法相当。
- 适合高可靠性需求的自动驾驶、医疗等安全关键场景使用。
深度神经网络(DNN)广泛应用于安全关键领域,确保其可靠性至关重要。三重模冗余(TMR)是应对位翻转故障的有效技术,但其开销较大,因此需选择对模型输出贡献最大的参数和组件进行保护。本文提出一种基于可解释人工智能(XAI)的高效TMR方法,利用层间相关性传播(LRP)这一低成本梯度方法,为DNN参数生成重要性评分,并据此实施针对性冗余保护。该方法在VGG16和AlexNet模型上,基于MNIST与CIFAR-10数据集进行评估。结果表明,在10^-4位错误率下,AlexNet模型的可靠性提升超过60%,且冗余开销与现有最优方法持平。
原文摘要 · Abstract (English)
Deep Neural Networks (DNNs) are widely employed in safety-critical domains, where ensuring their reliability is essential. Triple Modular Redundancy (TMR) is an effective technique to enhance the reliability of DNNs in the presence of bit-flip faults. In order to handle the significant overhead of TMR, it is applied selectively on the parameters and components with the highest contribution at the model output. Hence, the accuracy of the selection criterion plays the key role on the efficiency of TMR. This paper presents an efficient TMR approach to enhance the reliability of DNNs against bit-flip faults using an Explainable Artificial Intelligence (XAI) method. Since XAI can provide valuable insights about the importance of individual neurons and weights in the performance of the network, they can be applied as the selection metric in TMR techniques. The proposed method utilizes a low-cost, gradient-based XAI technique known as Layer-wise Relevance Propagation (LRP) to calculate importance scores for DNN parameters. These scores are then used to enhance the reliability of the model, with the most critical weights being protected by TMR. The proposed approach is evaluated on two DNN models, VGG16 and AlexNet, using datasets such as MNIST and CIFAR-10. The results demonstrate that the method can protect the AlexNet model at a bit error rate of 10-4, achieving over 60% reliability improvement while maintaining the same overhead as state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。