ALADIN可提前分析嵌入式AI加速器的精度与延迟权衡,省去实测成本。
ALADIN: Accuracy-Latency-Aware Design-space Inference Analysis for Embedded AI Accelerators
- 将QONNX模型逐步转为适配硬件的表示,融合平台无关与特定特征。
- 在模拟器上验证,发现架构设计和混合精度量化显著影响性能与资源消耗。
- 适合做嵌入式AI软硬协同设计的开发者,尤其关注实时性与能效的场景。
在资源受限的嵌入式系统上部署深度神经网络(DNN)推理,需在模型精度、计算延迟与硬件限制间权衡,尤其当满足实时性要求时更为复杂。本文提出ALADIN——一种面向基于寄存器堆的AI加速器、针对混合精度量化神经网络(QNNs)的精度-延迟感知设计空间分析框架。ALADIN可在无需部署到目标平台的情况下,评估与分析推理瓶颈及设计权衡,大幅降低开发时间与成本。该框架引入渐进式精化流程,将标准QONNX模型转化为平台感知表示,整合平台无关实现细节与硬件特异性信息。使用基于RISC-V的专用AI工作负载周期精确模拟器进行验证,结果表明ALADIN有效支持定量推理分析与软硬协同设计。实验揭示了架构决策与混合精度量化策略对精度、延迟和资源消耗的影响,并证明这些影响可通过ALADIN精准评估与对比,同时暴露了微妙的优化矛盾。
原文摘要 · Abstract (English)
The inference of deep neural networks (DNNs) on resource-constrained embedded systems introduces non-trivial trade-offs among model accuracy, computational latency, and hardware limitations, particularly when real-time constraints must be satisfied. This paper presents ALADIN, an accuracy-latency-aware design-space inference analysis framework for mixed-precision quantized neural networks (QNNs) targeting scratchpad-based AI accelerators. ALADIN enables the evaluation and analysis of inference bottlenecks and design trade-offs across accuracy, latency, and resource consumption without requiring deployment on the target platform, thereby significantly reducing development time and cost. The framework introduces a progressive refinement process that transforms a canonical QONNX model into platform-aware representations by integrating both platform-independent implementation details and hardware-specific characteristics. ALADIN is validated using a cycle-accurate simulator of a RISC-V based platform specialized for AI workloads, demonstrating its effectiveness as a tool for quantitative inference analysis and hardware-software co-design. Experimental results highlight how architectural decisions and mixed-precision quantization strategies impact accuracy, latency, and resource usage, and show that these effects can be precisely evaluated and compared using ALADIN, while also revealing subtle optimization tensions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。