J3DAI是面向3D堆叠图像传感器的微型神经网络加速器,实现低功耗边缘智能。
J3DAI: A tiny DNN-Based Edge AI Accelerator for 3D-Stacked CMOS Image Sensor
- 基于3层3D堆叠CMOS设计,集成轻量DNN加速单元
- 支持图像分类与分割,实测低功耗下高效运行
- 适配资源受限设备,适合实时边缘视觉应用
本文提出J3DAI,一种面向三层3D堆叠CMOS图像传感器的微型深度神经网络(DNN)硬件加速器,集成人工智能芯片并内含基于DNN的加速单元,可高效执行图像分类与分割等任务。论文聚焦于J3DAI的数字系统设计,突出其性能-功耗-面积(PPA)优势,并展示在CMOS图像传感器上的先进边缘AI能力。为支持硬件开发,采用Aidge综合软件框架,实现主机处理器与DNN加速器的联合编程;该框架支持后训练量化,显著降低内存占用与计算复杂度,对部署于资源受限设备如J3DAI至关重要。实验结果表明,该设计在边缘AI领域具备高度灵活性与效率,可应对从简单到高计算强度的任务。未来工作将优化架构并拓展新应用场景,充分释放J3DAI潜力。随着边缘AI日益重要,像J3DAI这样的创新将在边缘实现实时、低延迟、低功耗智能处理中发挥关键作用。
原文摘要 · Abstract (English)
This paper presents J3DAI, a tiny deep neural network-based hardware accelerator for a 3-layer 3D-stacked CMOS image sensor featuring an artificial intelligence (AI) chip integrating a Deep Neural Network (DNN)-based accelerator. The DNN accelerator is designed to efficiently perform neural network tasks such as image classification and segmentation. This paper focuses on the digital system of J3DAI, highlighting its Performance-Power-Area (PPA) characteristics and showcasing advanced edge AI capabilities on a CMOS image sensor. To support hardware, we utilized the Aidge comprehensive software framework, which enables the programming of both the host processor and the DNN accelerator. Aidge supports post-training quantization, significantly reducing memory footprint and computational complexity, making it crucial for deploying models on resource-constrained hardware like J3DAI. Our experimental results demonstrate the versatility and efficiency of this innovative design in the field of edge AI, showcasing its potential to handle both simple and computationally intensive tasks. Future work will focus on further optimizing the architecture and exploring new applications to fully leverage the capabilities of J3DAI. As edge AI continues to grow in importance, innovations like J3DAI will play a crucial role in enabling real-time, low-latency, and energy-efficient AI processing at the edge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。