研究嵌入式AI在单粒子翻转下的鲁棒性,为自动驾驶等安全场景提供可靠保障。
Evaluating Single Event Upsets in Deep Neural Networks for Semantic Segmentation: an embedded system perspective
- 逐层逐位分析卷积神经网络对单粒子翻转的敏感性
- 发现模型剪枝与量化会降低抗错能力,影响分割精度
- 提出零开销轻量级纠错技术,适合资源受限设备
随着人工智能算法在边缘设备中的广泛应用,提升自主AI感知与决策系统的鲁棒性和可靠性变得与精度和性能同样重要,尤其在自动驾驶、航空航天等安全关键领域。本文从嵌入式系统视角,评估深度神经网络(DNN)在单粒子翻转(SEU)引起的参数扰动下的鲁棒性,重点研究卷积神经网络(CNN)在图像语义分割任务中的表现。通过分层分比特的敏感性分析,全面考察不同编码器-解码器模型对软错误的脆弱性,并评估模型剪枝与参数量化对压缩模型鲁棒性的负面影响。研究结果揭示了SEU导致失效的内在机制,有助于预先评估训练后DNN的可靠性。基于实验数据,提出一系列无需额外内存或计算成本的轻量级错误缓解技术,适用于资源受限部署。故障注入实验代码见https://github.com/jonGuti13/TensorFI2,所提技术实现代码见https://github.com/jonGuti13/parameterProtection。
原文摘要 · Abstract (English)
As the deployment of artifical intelligence (AI) algorithms at edge devices becomes increasingly prevalent, enhancing the robustness and reliability of autonomous AI-based perception and decision systems is becoming as relevant as precision and performance, especially in applications areas considered safety-critical such as autonomous driving and aerospace. This paper delves into the robustness assessment in embedded Deep Neural Networks (DNNs), particularly focusing on the impact of parameter perturbations produced by single event upsets (SEUs) on convolutional neural networks (CNN) for image semantic segmentation. By scrutinizing the layer-by-layer and bit-by-bit sensitivity of various encoder-decoder models to soft errors, this study thoroughly investigates the vulnerability of segmentation DNNs to SEUs and evaluates the consequences of techniques like model pruning and parameter quantization on the robustness of compressed models aimed at embedded implementations. The findings offer valuable insights into the mechanisms underlying SEU-induced failures that allow for evaluating the robustness of DNNs once trained in advance. Moreover, based on the collected data, we propose a set of practical lightweight error mitigation techniques with no memory or computational cost suitable for resource-constrained deployments. The code used to perform the fault injection (FI) campaign is available at https://github.com/jonGuti13/TensorFI2 , while the code to implement proposed techniques is available at https://github.com/jonGuti13/parameterProtection .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。