通过关键路径检测深度神经网络中的异常输入,准确率更高且适用范围广。
Anomaly Detection Based on Critical Paths for Deep Neural Networks
- 用遗传算法筛选出对分类至关重要的神经路径
- 集成多条路径的检测结果,提升对异常的识别能力
- 适合检测各类异常,尤其对对抗样本效果显著
深度神经网络(DNN)难以理解且防御困难。近期研究表明,借助软件工程方法提取DNN中的代表性路径(包括神经元激活值及连接关系),有助于解释黑箱模型的决策过程,因为这些路径常能捕捉关键特征。本文提出一种新方法:先通过遗传进化与突变识别关键检测路径,再基于这些路径进行异常检测。由于异常输入与正常输入在关键路径上的激活模式差异明显,该方法可有效识别。为增强鲁棒性,采用随机子空间采样与投票机制融合多条路径的检测结果。实验表明,本方法在多种异常类型上均优于现有技术,具有高精度和广泛适用性。
原文摘要 · Abstract (English)
Deep neural networks (DNNs) are notoriously hard to understand and difficult to defend. Extracting representative paths (including the neuron activation values and the connections between neurons) from DNNs using software engineering approaches has recently shown to be a promising approach in interpreting the decision making process of blackbox DNNs, as the extracted paths are often effective in capturing essential features. With this in mind, this work investigates a novel approach that extracts critical paths from DNNs and subsequently applies the extracted paths for the anomaly detection task, based on the observation that outliers and adversarial inputs do not usually induce the same activation pattern on those paths as normal (in-distribution) inputs. In our approach, we first identify critical detection paths via genetic evolution and mutation. Since different paths in a DNN often capture different features for the same target class, we ensemble detection results from multiple paths by integrating random subspace sampling and a voting mechanism. Compared with state-of-the-art methods, our experimental results suggest that our method not only outperforms them, but it is also suitable for the detection of a broad range of anomaly types with high accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。