arXiv:2504.05119cs.LGcs.AI2025-04被引 1

选对激活函数可让嵌入式神经网络更抗硬件误差,兼顾速度与可靠性。

Balancing Robustness and Efficiency in Embedded DNNs Through Activation Function Selection

  • 用有界激活函数提升模型对参数扰动的鲁棒性。
  • 在KV260平台上验证了其在精度、压缩率和计算开销间的平衡。
  • 适合做自动驾驶等高安全要求场景的轻量化模型设计。

面向航空航天和自动驾驶等安全关键应用的嵌入式机器学习系统,必须抵御软错误引起的扰动。随着晶体管尺寸缩小和电压降低,现代电子设备对背景辐射更敏感,软错误导致的故障风险上升。深度神经网络(DNN)对这类错误的韧性不仅取决于器件技术,还受模型结构、参数数值表示及计算精度影响。剪枝与量化等压缩技术虽能降低内存占用和计算复杂度,但会改变模型结构与表示,进而影响软错误鲁棒性。本文研究中,尽管常被忽略,激活函数(AFs)的选择不仅影响准确性与可训练性,还关系到可压缩性与抗错能力。本文采用无技术依赖的方法,探索使用有界激活函数以增强对参数扰动的鲁棒性,并评估其对模型精度、压缩性和计算负载的影响。研究聚焦于用于高光谱图像语义分割的编码器-解码器卷积模型,应用于自动驾驶系统。实验在AMD-Xilinx KV260 SoM平台上进行。

原文摘要 · Abstract (English)

Machine learning-based embedded systems for safety-critical applications, such as aerospace and autonomous driving, must be robust to perturbations caused by soft errors. As transistor geometries shrink and voltages decrease, modern electronic devices become more susceptible to background radiation, increasing the concern about failures produced by soft errors. The resilience of deep neural networks (DNNs) to these errors depends not only on target device technology but also on model structure and the numerical representation and arithmetic precision of their parameters. Compression techniques like pruning and quantization, used to reduce memory footprint and computational complexity, alter both model structure and representation, affecting soft error robustness. In this regard, although often overlooked, the choice of activation functions (AFs) impacts not only accuracy and trainability but also compressibility and error resilience. This paper explores the use of bounded AFs to enhance robustness against parameter perturbations, while evaluating their effects on model accuracy, compressibility, and computational load with a technology-agnostic approach. We focus on encoder-decoder convolutional models developed for semantic segmentation of hyperspectral images with application to autonomous driving systems. Experiments are conducted on an AMD-Xilinx's KV260 SoM.

嵌入式AI软错误激活函数模型压缩

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。