用传统算法生成神经网络的行为规范,提升系统可信度
Specification Generation for Neural Networks in Systems
- 以经典算法为参考,自动提取神经网络应有行为
- 在自适应码率和拥塞控制中生成可验证的规范
- 发现现有先进模型隐藏漏洞,适合系统安全研究者
规范是精确描述特定领域正确行为的数学表达,对保障计算机系统可信性至关重要。随着神经网络作为系统组件广泛应用,其黑箱特性使规范愈发重要,可用于约束模型行为。传统规范依赖领域专家经验设计,成本高且难以扩展。本文提出假设:若神经网络取代了已有长期验证的传统算法,则这些算法可作为模型正确行为的有效代理。基于此,我们提出自动化框架SpecTRA,将规范生成建模为优化问题,利用参考算法的观测行为进行求解。SpecTRA通过聚类相似行为生成紧凑规范。我们在自适应码率与拥塞控制算法的神经网络中应用该框架,生成的规范符合直觉且具正确性证据。进一步,利用这些规范揭示了当前最先进系统模型中的多个未知漏洞。
原文摘要 · Abstract (English)
Specifications - precise mathematical representations of correct domain-specific behaviors - are crucial to guarantee the trustworthiness of computer systems. With the increasing development of neural networks as computer system components, specifications gain more importance as they can be used to regulate the behaviors of these black-box models. Traditionally, specifications are designed by domain experts based on their intuition of correct behavior. However, this is labor-intensive and hence not a scalable approach as computer system applications diversify. We hypothesize that the traditional (aka reference) algorithms that neural networks replace for higher performance can act as effective proxies for correct behaviors of the models, when available. This is because they have been used and tested for long enough to encode several aspects of the trustworthy/correct behaviors in the underlying domain. Driven by our hypothesis, we develop a novel automated framework, SpecTRA to generate specifications for neural networks using references. We formulate specification generation as an optimization problem and solve it with observations of reference behaviors. SpecTRA clusters similar observations into compact specifications. We present specifications generated by SpecTRA for neural networks in adaptive bit rate and congestion control algorithms. Our specifications show evidence of being correct and matching intuition. Moreover, we use our specifications to show several unknown vulnerabilities of the SOTA models for computer systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。