探究深度模型结构与神经覆盖度的关系,揭示测试有效性关键因素
Towards Understanding Deep Learning Model in Image Recognition via Coverage Test
- 通过四种覆盖度指标分析不同深度网络的神经激活模式
- 发现模型深度和配置影响覆盖率,5-54层间差异显著
- 适合关注AI模型安全测试的开发者与研究人员
深度神经网络(DNN)在人工智能领域至关重要,其安全测试成为研究热点。通过输入测试用例,可检测模型异常行为,并利用覆盖度指标衡量测试对神经元的覆盖范围。随着DNN广泛应用,多种神经行为引发关注,催生了各类覆盖度指标。然而,当前缺乏对这些指标的实证研究,尤其缺少对模型深度、配置信息与覆盖度之间关系的系统分析。本文聚焦四种覆盖度指标:主功能、边界、层次与结构覆盖,选取LeNet、VGG和ResNet等架构,构建10个深度从5到54层的模型,系统比较不同深度与配置对覆盖度的影响。同时考察修改后的判定/条件覆盖与数据集规模的关系。最后提出三个未来研究方向,以推动DNN安全测试的发展。
原文摘要 · Abstract (English)
Deep neural networks (DNNs) play a crucial role in the field of artificial intelligence, and their security-related testing has been a prominent research focus. By inputting test cases, the behavior of models is examined for anomalies, and coverage metrics are utilized to determine the extent of neurons covered by these test cases. With the widespread application and advancement of DNNs, different types of neural behaviors have garnered attention, leading to the emergence of various coverage metrics for neural networks. However, there is currently a lack of empirical research on these coverage metrics, specifically in analyzing the relationships and patterns between model depth, configuration information, and neural network coverage. This paper aims to investigate the relationships and patterns of four coverage metrics: primary functionality, boundary, hierarchy, and structural coverage. A series of empirical experiments were conducted, selecting LeNet, VGG, and ResNet as different DNN architectures, along with 10 models of varying depths ranging from 5 to 54 layers, to compare and study the relationships between different depths, configuration information, and various neural network coverage metrics. Additionally, an investigation was carried out on the relationships between modified decision/condition coverage and dataset size. Finally, three potential future directions are proposed to further contribute to the security testing of DNN Models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。