arXiv:2501.14009cs.LGcs.AI2025-01被引 5

用压缩图像空间提升自动驾驶神经控制器的可验证性与可解释性

Scalable and Interpretable Verification of Image-based Neural Network Controllers for Autonomous Vehicles

  • 通过变分自编码器将图像降维至可解释的潜在空间
  • 构建凸多面体结构,使验证效率提升且支持抗扰动分析
  • 适合关注自动驾驶安全验证与模型可解释性的研究者

现有针对自动驾驶图像神经控制器的形式化验证方法在高维输入、计算效率和可解释性方面存在局限,难以保障系统安全可靠。为此,我们提出SEVIN框架,利用变分自编码器(VAE)将高维图像编码为低维可解释的潜在空间。通过为潜在变量标注对应控制动作,生成用于验证的凸多面体,显著降低计算复杂度并增强可扩展性。将VAE解码器与神经网络控制器结合,实现基于可解释多面体的正式验证与鲁棒性分析。通过数据增强与重训练,使VAE能捕捉真实环境变化,提升对扰动的鲁棒性。实验表明,SEVIN在保持高效可扩展的同时,提供对控制器行为的可解释洞察,弥合形式化验证与实际安全关键系统应用之间的差距。

原文摘要 · Abstract (English)

Existing formal verification methods for image-based neural network controllers in autonomous vehicles often struggle with high-dimensional inputs, computational inefficiency, and a lack of explainability. These challenges make it difficult to ensure safety and reliability, as processing high-dimensional image data is computationally intensive and neural networks are typically treated as black boxes. To address these issues, we propose SEVIN (Scalable and Explainable Verification of Image-Based Neural Network Controllers), a framework that leverages a Variational Autoencoders (VAE) to encode high-dimensional images into a lower-dimensional, explainable latent space. By annotating latent variables with corresponding control actions, we generate convex polytopes that serve as structured input spaces for verification, significantly reducing computational complexity and enhancing scalability. Integrating the VAE's decoder with the neural network controller allows for formal and robustness verification using these explainable polytopes. Our approach also incorporates robustness verification under real-world perturbations by augmenting the dataset and retraining the VAE to capture environmental variations. Experimental results demonstrate that SEVIN achieves efficient and scalable verification while providing explainable insights into controller behavior, bridging the gap between formal verification techniques and practical applications in safety-critical systems.

自动驾驶神经网络验证可解释性VAE

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。