arXiv:2506.22321cs.SDcs.AI2025-06被引 1

通过亚奈奎斯特采样与低比特分辨率,显著降低耳戴设备功耗。

SUBARU: A Practical Approach to Power Saving in Hearables Using SUB-Nyquist Audio Resolution Upsampling

  • 在ADC中采用亚奈奎斯特采样和低比特精度以节能
  • 实现1.74毫秒推理延迟,内存占用小于13.77MB
  • 适合移动平台实时语音增强,尤其适用于嘈杂环境

耳戴设备是佩戴在耳朵上的可穿戴计算机。骨传导麦克风(BCMs)与空气传导麦克风(ACMs)结合使用,可在嘈杂环境下实现多模态语音增强(SE)。然而,现有方法未充分考虑耳戴设备低功耗实现中的实际问题:(i) 未探究降低模拟-数字转换器(ADC)的采样频率和比特分辨率如何共同影响低功耗处理及语音质量与可懂度;(iii) 因缺乏从窄带部分重构宽带信号的方法,无法对ACM/BCM信号进行亚奈奎斯特采样处理。本文提出SUBARU(Sub-Nyquist Audio Resolution Upsampling),实现了:(i) 故意在ADC中使用亚奈奎斯特采样和低比特分辨率,功耗降低3.31倍;(ii) 在移动平台实现流式处理,在真实环境噪声下完成语音增强,推理时间仅1.74毫秒,内存占用低于13.77MB。

原文摘要 · Abstract (English)

Hearables are wearable computers that are worn on the ear. Bone conduction microphones (BCMs) are used with air conduction microphones (ACMs) in hearables as a supporting modality for multimodal speech enhancement (SE) in noisy conditions. However, existing works don't consider the following practical aspects for low-power implementations on hearables: (i) They do not explore how lowering the sampling frequencies and bit resolutions in analog-to-digital converters (ADCs) of hearables jointly impact low-power processing and multimodal SE in terms of speech quality and intelligibility. And (iii) They don't process signals from ACMs/BCMs at a sub-Nyquist sampling rate because, in their frameworks, they lack a wideband reconstruction methodology from their narrowband parts. We propose SUBARU (\textbf{Sub}-Nyquist \textbf{A}udio \textbf{R}esolution \textbf{U}psampling), which achieves the following: SUBARU (i) intentionally uses sub-Nyquist sampling and low bit resolution in ADCs, achieving a 3.31x reduction in power consumption; and (ii) achieves streaming operations on mobile platforms and SE in in-the-wild noisy conditions with an inference time of 1.74ms and a memory footprint of less than 13.77MB.

耳戴设备语音增强低功耗亚奈奎斯特

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。