arXiv:2512.00059cs.ARcs.LG2025-12被引 1

提出抗故障设计SafeCiM,提升浮点存内计算加速器可靠性

SafeCiM: Investigating Resilience of Hybrid Floating-Point Compute-in-Memory Deep Learning Accelerators

  • 在存内计算中引入比特翻转故障,系统分析浮点运算脆弱性
  • 单个加法器故障可使大模型准确率降至0%,暴露严重风险
  • 新架构SafeCiM通过预对齐机制,故障影响降低49倍,适合关键任务

深度神经网络(DNN)持续增长,大语言模型(LLMs)参数量庞大。传统加速器受限于数据传输瓶颈,促使存内计算(CiM)架构发展,将计算集成于或靠近内存以减少数据移动。近期研究探索了使用浮点(FP)与整数(INT)运算的CiM设计。浮点计算因动态范围广、精度高,输出质量更优,尤其适用于对精度敏感的生成式AI应用,如大语言模型,推动了浮点存内计算加速器的发展。然而,浮点存内计算对硬件故障的脆弱性尚未充分研究,这在关键任务场景中构成重大可靠性隐患。为此,本文系统分析浮点存内计算中硬件故障的影响,通过在数字乘法器、存内存储单元和数字累加树等关键阶段引入比特翻转故障,实验涵盖卷积神经网络(如AlexNet)及前沿大模型(如LLaMA-3.2-1B和Qwen-0.3B-Base),揭示各阶段故障对推理准确率的影响。值得注意的是,单个加法器故障可导致大模型准确率降至0%。基于此,本文提出抗故障设计SafeCiM,其性能远优于原始浮点存内计算架构。例如,在4096个MAC单元下,面对单个加法器故障,SafeCiM将准确率下降幅度降低达49倍。

原文摘要 · Abstract (English)

Deep Neural Networks (DNNs) continue to grow in complexity with Large Language Models (LLMs) incorporating vast numbers of parameters. Handling these parameters efficiently in traditional accelerators is limited by data-transmission bottlenecks, motivating Compute-in-Memory (CiM) architectures that integrate computation within or near memory to reduce data movement. Recent work has explored CiM designs using Floating-Point (FP) and Integer (INT) operations. FP computations typically deliver higher output quality due to their wider dynamic range and precision, benefiting precision-sensitive Generative AI applications. These include models such as LLMs, thus driving advancements in FP-CiM accelerators. However, the vulnerability of FP-CiM to hardware faults remains underexplored, posing a major reliability concern in mission-critical settings. To address this gap, we systematically analyze hardware fault effects in FP-CiM by introducing bit-flip faults at key computational stages, including digital multipliers, CiM memory cells, and digital adder trees. Experiments with Convolutional Neural Networks (CNNs) such as AlexNet and state-of-the-art LLMs including LLaMA-3.2-1B and Qwen-0.3B-Base reveal how faults at each stage affect inference accuracy. Notably, a single adder fault can reduce LLM accuracy to 0%. Based on these insights, we propose a fault-resilient design, SafeCiM, that mitigates fault impact far better than a naive FP-CiM with a pre-alignment stage. For example, with 4096 MAC units, SafeCiM reduces accuracy degradation by up to 49x for a single adder fault compared to the baseline FP-CiM architecture.

存内计算浮点计算故障韧性大模型加速

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。