arXiv:2503.00340eess.AScs.AI2025-03中稿 · IEEE TASLP被引 11

用搜索找到极简语音增强模型,手机也能实时运行。

UL-UNAS: Ultra-Lightweight U-Nets for Real-Time Speech Enhancement via Network Architecture Search

  • 通过神经架构搜索优化轻量级U-Net结构。
  • 在相同算力下,性能超越现有最紧凑模型。
  • 适合嵌入式设备,适合移动端实时语音增强。

轻量化模型对实时语音增强至关重要。近年来,语音增强领域持续追求更紧凑的模型。本文提出一种基于网络架构搜索的超轻量级U-Net(UL-UNAS),适用于低资源设备部署。首先,在U-Net框架内探索多种高效卷积模块,筛选最优候选。其次,引入两个增强组件:一种新型激活函数affine PReLU和因果时频注意力模块,提升模块表达能力。进一步地,利用神经架构搜索在精心设计的搜索空间中发现最优结构。实验表明,UL-UNAS在计算复杂度相同或更低的情况下,显著优于最新超轻量模型;同时,在远低于基准模型算力需求的前提下,仍保持竞争力。源代码与音频演示见 https://github.com/Xiaobin-Rong/ul-unas。

原文摘要 · Abstract (English)

Lightweight models are essential for real-time speech enhancement applications. In recent years, there has been a growing trend toward developing increasingly compact models for speech enhancement. In this paper, we propose an Ultra-Lightweight U-net optimized by Network Architecture Search (UL-UNAS), which is suitable for implementation in low-footprint devices. Firstly, we explore the application of various efficient convolutional blocks within the U-Net framework to identify the most promising candidates. Secondly, we introduce two boosting components to enhance the capacity of these convolutional blocks: a novel activation function named affine PReLU and a causal time-frequency attention module. Furthermore, we leverage neural architecture search to discover an optimal architecture within our carefully designed search space. By integrating the above strategies, UL-UNAS not only significantly outperforms the latest ultra-lightweight models with the same or lower computational complexity, but also delivers competitive performance compared to recent baseline models that require substantially higher computational resources. Source code and audio demos are available at https://github.com/Xiaobin-Rong/ul-unas.

语音增强轻量模型神经架构搜索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。