arXiv:2410.10434eess.AScs.SD2024-10被引 18

用材料内计算实现低功耗语音识别,边端处理更高效安全。

In-Materia Speech Recognition

  • 采用材料内计算架构,在时域直接提取音频特征
  • 在TI-46词语音识别任务中达到96.2%准确率
  • 适合对功耗与实时性要求高的边缘智能设备

随着物联网、自动驾驶和个性化医疗等去中心化计算的发展,高效地在数据采集端(边缘)处理时序信号变得愈发重要,避免与中心计算设施通信带来的延迟、安全隐患和成本。然而,现有处理器受限于冯·诺依曼瓶颈或模数转换、时频转换等架构缺陷,难以满足边缘系统的功耗与时间约束。本文提出一种基于两种材料内计算系统(非线性室温掺杂网络处理单元DNPU和类存内计算芯片AIMC)的边缘时序信号处理器,实现从原始音频中直接进行模拟时域特征提取与分类。其中,DNPU层模仿人耳耳蜗功能,完成模拟时域特征提取;AIMC芯片由忆阻交叉阵列构成,对提取特征执行紧凑型神经网络分类。该系统在TI-46词语音识别任务中达96.2%软件级准确率,且DNPU特征提取仅耗电100s nW,AIMC分类每乘加操作可低于10 fJ。研究成果为异构智能边缘处理器的紧凑性、效率与性能提升提供了新路径。

原文摘要 · Abstract (English)

With the rise of decentralized computing, as in the Internet of Things, autonomous driving, and personalized healthcare, it is increasingly important to process time-dependent signals at the edge efficiently: right at the place where the temporal data are collected, avoiding time-consuming, insecure, and costly communication with a centralized computing facility (or cloud). However, modern-day processors often cannot meet the restrained power and time budgets of edge systems because of intrinsic limitations imposed by their architecture (von Neumann bottleneck) or domain conversions (analogue-to-digital and time-to-frequency). Here, we propose an edge temporal-signal processor based on two in-materia computing systems for both feature extraction and classification, reaching a software-level accuracy of 96.2% for the TI-46-Word speech-recognition task. First, a nonlinear, room-temperature dopant-network-processing-unit (DNPU) layer realizes analogue, time-domain feature extraction from the raw audio signals, similar to the human cochlea. Second, an analogue in-memory computing (AIMC) chip, consisting of memristive crossbar arrays, implements a compact neural network trained on the extracted features for classification. With the DNPU feature extraction consuming 100s nW and AIMC-based classification having the potential for less than 10 fJ per multiply-accumulate operation, our findings offer a promising avenue for advancing the compactness, efficiency, and performance of heterogeneous smart edge processors through in-materia computing hardware.

边缘计算材料内计算语音识别低功耗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。