arXiv:2410.15742cs.LGcs.AR2024-10被引 1

提出快速精准的神经网络故障容错分析方法,大幅缩短测试时间。

DeepVigor+: Scalable and Accurate Semi-Analytical Fault Resilience Analysis for Deep Neural Network

  • 基于故障传播模型,半解析计算神经网络脆弱性因子。
  • 误差低于1%,模拟次数减少14.9至26.9倍。
  • 适合大模型可靠性评估,尤其适用于安全关键场景。

机器学习在安全关键应用中的普及对系统安全性分析提出更高要求。硬件可靠性评估是衡量基于机器学习系统安全性的核心挑战。由于卷积神经网络(CNN)参数与计算量巨大,其可靠性量化极为复杂。传统故障注入(FI)方法在现代大型CNN上耗时过长,难以满足高置信度需求。虽有统计故障注入(SFI)可加速,但运行时间仍较长。本文提出DeepVigor+,一种可扩展、快速且准确的半解析方法,用于高效评估CNN可靠性。该方法通过故障传播分析模型,优化获取脆弱性因子(VFs)作为可靠性度量。实验表明,DeepVigor+在误差小于1%的前提下,所需模拟次数仅为当前最优SFI方法的14.9至26.9倍。该方法可在数分钟内完成大规模深层CNN的精确可靠性分析,而传统方法需数天甚至数周。

原文摘要 · Abstract (English)

The growing exploitation of Machine Learning (ML) in safety-critical applications necessitates rigorous safety analysis. Hardware reliability assessment is a major concern with respect to measuring the level of safety in ML-based systems. Quantifying the reliability of emerging ML models, including Convolutional Neural Networks (CNNs), is highly complex due to their enormous size in terms of the number of parameters and computations. Conventionally, Fault Injection (FI) is applied to perform a reliability measurement. However, performing FI on modern-day CNNs is prohibitively time-consuming if an acceptable confidence level is to be achieved. To speed up FI for large CNNs, statistical FI (SFI) has been proposed, but its runtimes are still considerably long. In this work, we introduce DeepVigor+, a scalable, fast, and accurate semi-analytical method as an efficient alternative for reliability measurement in CNNs. DeepVigor+ implements a fault propagation analysis model and attempts to acquire Vulnerability Factors (VFs) as reliability metrics in an optimal way. The results indicate that DeepVigor+ obtains VFs for CNN models with an error less than $1\%$, i.e., the objective in SFI, but with $14.9$ up to $26.9$ times fewer simulations than the best-known state-of-the-art SFI. DeepVigor+ enables an accurate reliability analysis for large and deep CNNs within a few minutes, rather than achieving the same results in days or weeks.

故障分析深度学习可靠性CNN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。