arXiv:2508.15685cs.ARcs.AI2025-08中稿 · appear at ICCAD'25被引 1

提出行列混合分组方法,提升存内计算抗故障能力。

Row-Column Hybrid Grouping for Fault-Resilient Multi-Bit Weight Representation on IMC Arrays

  • 用行列双重冗余设计多比特权重表示,增强抗故障能力。
  • 编译时间快150倍,准确率最高提升8个百分点。
  • 适合部署在易出故障的存内计算硬件上。

本文针对模拟存内计算(IMC)系统中限制其可扩展性和实用性的两大挑战——由卡死故障(SAFs)引发的计算不可靠性,以及现有无故障(FF)算法编译开销过高的问题,提出两项改进:首先,提出一种新型多比特权重表示技术——行列混合分组,通过在行和列方向引入冗余,推广传统列分组方法,显著提升容错能力,并可与已有容错方案兼容;其次,设计一个编译器流水线,将容错权重分解问题重构为整数线性规划(ILP)任务,利用现成求解器实现快速、可扩展的编译。进一步结合理论分析,识别出可直接求解的故障模式,大幅减少计算量。在卷积网络和小型语言模型上的实验表明,该方法相较现有基线实现最高8%的准确率提升,编译速度提升150倍,能效提高2倍。

原文摘要 · Abstract (English)

This paper addresses two critical challenges in analog In-Memory Computing (IMC) systems that limit their scalability and deployability: the computational unreliability caused by stuck-at faults (SAFs) and the high compilation overhead of existing fault-mitigation algorithms, namely Fault-Free (FF). To overcome these limitations, we first propose a novel multi-bit weight representation technique, termed row-column hybrid grouping, which generalizes conventional column grouping by introducing redundancy across both rows and columns. This structural redundancy enhances fault tolerance and can be effectively combined with existing fault-mitigation solutions. Second, we design a compiler pipeline that reformulates the fault-aware weight decomposition problem as an Integer Linear Programming (ILP) task, enabling fast and scalable compilation through off-the-shelf solvers. Further acceleration is achieved through theoretical insights that identify fault patterns amenable to trivial solutions, significantly reducing computation. Experimental results on convolutional networks and small language models demonstrate the effectiveness of our approach, achieving up to 8%p improvement in accuracy, 150x faster compilation, and 2x energy efficiency gain compared to existing baselines.

存内计算抗故障编译优化权重表示

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。