arXiv:2608.22378cs.ARcs.ET2026-08

通过近似计算优化浮点乘法器,提升硬件效率同时保持模型精度。

Precision-Aware Variable Bit Processing Elements for Hardware-Efficient Systolic Array Designs

论文配图:Precision-Aware Variable Bit Processing Elements for Hardware-Efficient Systolic Array Designs
图 1 · 摘自论文原文
  • 在权值固定型脉动阵列中,对浮点乘法器进行部分积矩阵截断与压缩优化。
  • 相比精确实现,硬件面积减少66%~92%,功耗降低60%~93%,延迟改善21%~54%。
  • 适用于对误差容忍的深度学习加速场景,尤其适合CNN推理部署。

脉动阵列(SAs)已成为深度学习矩阵运算的重要硬件加速器,而浮点数格式可实现计算域内的精度控制。本研究针对权值固定型脉动阵列中的浮点(FP)乘法器,探讨近似计算技术,聚焦于IEEE 754(FP32)、TensorFloat-32(TF32)和脑浮点(BF16)格式。通过将部分积矩阵(PPM)列截断与正负压缩器结合,优化计算效率与精度之间的权衡。采用NSGA-II优化算法探索庞大设计空间,以生成高效且输出质量可接受的FP乘法器设计。在多种应用中均观察到显著硬件优势,同时保持输出质量。基于近似处理的处理单元在训练于MNIST、F-MNIST和CIFAR-10数据集上的卷积神经网络(CNN)中表现相当。性能排名前10的近似化脉动阵列设计,在运行训练好的CIFAR-10模型时,相较文献中对应精确实现,实现了66%至92%的面积节省、60%至93%的功耗降低,以及21%至54%的延迟改进。TF32与BF16近似设计也实现了显著增益,同时维持相近的CNN精度。结果表明,针对浮点乘法器的定向近似能有效提升容错应用硬件加速器的效率,为现代计算架构中的硬件资源优化提供有效路径。

原文摘要 · Abstract (English)

Systolic arrays (SAs) have emerged as prominent hardware accelerators for matrix operations in deep learning, while floating point number formats enable precision control across computational domains. This research investigates approximate computing techniques for floating point (FP) multipliers in Weight Stationary Systolic Arrays, focusing on IEEE 754 (FP32), TensorFloat-32 (TF32), and Brain Floating point (BF16) formats. By integrating partial product matrix (PPM) column truncation with positive and negative compressors in the FP multiplier architecture, we optimize the trade-off between computational efficiency and accuracy. NSGA-II optimization algorithm was employed to explore the vast design space for evolving FP multiplier designs, towards achieving substantial hardware improvements while maintaining acceptable output quality. Substantial hardware benefits were observed in the FP multiplier designs across various applications, while preserving output quality. The FP approximated Processing Elements designed in the SA was found to offer comparable CNN accuracy for models trained on MNIST, F-MNIST, and CIFAR-10 dataset. The FP approximated SA designs that fall in the top 10 CNN performance offered substantial hardware gains in the range of 66% to 92% footprint savings, 60% to 93% of power benefits with 21% to 54% improvement in the delay when compared with the corresponding exact implementations mentioned in the literature for running the model trained on CIFAR-10 dataset. The TF32 and BF16 approximated SA designs also achieved substantial gains while maintaining comparable CNN accuracy. Our findings confirm that targeted approximation in FP multiplier design significantly improves the efficiency of hardware accelerators for error-tolerant applications, establishing an effective approach to hardware resource optimization in contemporary computing architectures.

脉动阵列浮点近似硬件优化低功耗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。