arXiv:2603.22770cs.LGcs.AI2026-03

用逻辑和查表结构提升神经网络抗硬件错误能力

From Arithmetic to Logic: The Resilience of Logic and Lookup-Based Neural Networks Under Parameter Bit-Flips

  • 从架构设计出发,分析参数位翻转下的鲁棒性机制
  • 查表模型在位翻转下比浮点模型更稳定,误差更低
  • 适合边缘安全场景中对可靠性要求高的部署

深度神经网络在安全关键的边缘环境中部署时,需抵御硬件引起的位翻转错误。尽管实证研究显示降低数值精度可提高容错能力,但其理论基础仍不明确。本文将鲁棒性视为神经网络架构的结构性属性,而非仅依赖特定数据集训练的解。通过推导多种数值格式和层结构在独立参数位翻转下的均方误差(MSE),发现低精度、高稀疏性、有界激活和浅层结构在该扰动模型下始终占优。我们进一步指出,逻辑与查表型神经网络实现了这些设计趋势的联合极限。在MLPerf Tiny基准上的消融实验表明,观测到的实证趋势与理论预测一致,且查表模型在标准浮点模型急剧失效的扰动环境下仍保持高度稳定。此外,我们发现逻辑架构独有的偶数层恢复效应,并分析了其出现的结构条件。总体而言,从连续算术权重转向离散布尔查找,可在准确率与抗干扰性之间实现更优权衡。

原文摘要 · Abstract (English)

The deployment of deep neural networks (DNNs) in safety-critical edge environments necessitates robustness against hardware-induced bit-flip errors. While empirical studies indicate that reducing numerical precision can improve fault tolerance, the theoretical basis of this phenomenon remains underexplored. In this work, we study resilience as a structural property of neural architectures rather than solely as a property of a dataset-specific trained solution. By deriving the expected squared error (MSE) under independent parameter bit flips across multiple numerical formats and layer primitives, we show that lower precision, higher sparsity, bounded activations, and shallow depth are consistently favored under this corruption model. We then argue that logic and lookup-based neural networks realize the joint limit of these design trends. Through ablation studies on the MLPerf Tiny benchmark suite, we show that the observed empirical trends are consistent with the theoretical predictions, and that LUT-based models remain highly stable in corruption regimes where standard floating-point models fail sharply. Furthermore, we identify a novel even-layer recovery effect unique to logic-based architectures and analyze the structural conditions under which it emerges. Overall, our results suggest that shifting from continuous arithmetic weights to discrete Boolean lookups can provide a favorable accuracy-resilience trade-off for hardware fault tolerance.

神经网络硬件容错查表网络鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。