arXiv:2603.03880cs.ARcs.AI2026-03中稿 · IEEE Access

提出联合软硬件优化框架,让内存计算加速器高效支持多种神经网络。

Joint Hardware-Workload Co-Optimization for In-Memory Computing Accelerators

  • 用进化算法同时优化硬件与多工作负载,避免单一模型定制化。
  • 在4个和9个工作负载上,能效延迟面积积分别降低76.2%和95.5%。
  • 适用于需要通用性部署的内存计算加速器设计,尤其适合多模型场景。

软件-硬件协同设计对优化内存计算(IMC)硬件加速器至关重要。然而,现有优化框架通常针对单一工作负载,导致硬件设计高度专用化,难以跨模型和应用泛化。实际部署场景要求单个IMC平台能高效支持多种神经网络工作负载。本文提出一种基于优化进化算法的联合硬件-工作负载协同优化框架,用于设计通用的IMC加速器架构。通过显式捕捉跨工作负载的权衡关系,而非仅优化单一模型,所提方法显著缩小了专用与通用IMC设计间的性能差距。该框架在RRAM和SRAM-based IMC架构上均进行了评估,展现出强鲁棒性和适应性。相较于基线方法,在4个和9个工作负载下,优化设计分别实现高达76.2%和95.5%的能效延迟面积积(EDAP)降低。框架源码已开源:https://github.com/OlgaKrestinskaya/JointHardwareWorkloadOptimizationIMC。

原文摘要 · Abstract (English)

Software-hardware co-design is essential for optimizing in-memory computing (IMC) hardware accelerators for neural networks. However, most existing optimization frameworks target a single workload, leading to highly specialized hardware designs that do not generalize well across models and applications. In contrast, practical deployment scenarios require a single IMC platform that can efficiently support multiple neural network workloads. This work presents a joint hardware-workload co-optimization framework based on an optimized evolutionary algorithm for designing generalized IMC accelerator architectures. By explicitly capturing cross-workload trade-offs rather than optimizing for a single model, the proposed approach significantly reduces the performance gap between workload-specific and generalized IMC designs. The framework is evaluated on both RRAM- and SRAM-based IMC architectures, demonstrating strong robustness and adaptability across diverse design scenarios. Compared to baseline methods, the optimized designs achieve energy-delay-area product (EDAP) reductions of up to 76.2% and 95.5% when optimizing across a small set (4 workloads) and a large set (9 workloads), respectively. The source code of the framework is available at https://github.com/OlgaKrestinskaya/JointHardwareWorkloadOptimizationIMC.

内存计算协同优化神经网络加速进化算法

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。