用混沌理论设计判别器,提升语音带宽扩展的保真度
CIS-BWE: Chaos-Informed Speech Bandwidth Extension
- 基于非线性动力系统设计七种新型判别器,捕捉语音的复杂动态特征
- 在六项客观指标和主观评测中均达到当前最优性能
- 适合语音处理、通信系统等需要高质量音频还原的场景
在通信和资源受限的高保真音频应用中,恢复因带宽限制丢失的高频成分至关重要。本文提出NDSI-BWE,一种基于对抗学习的带宽扩展框架,引入四种受非线性动力系统启发的新判别器:多分辨率李雅普诺夫判别器(MRLD)用于检测对初值的敏感性以捕捉确定性混沌;多尺度递归判别器(MS-RD)用于建模自相似递归动态;多尺度去趋势分形分析判别器(MSDFA)用于捕捉长程慢变尺度不变关系;多分辨率庞加莱图判别器(MR-PPD)用于揭示隐空间中的隐藏关系;多周期判别器(MPD)用于识别周期性模式;以及多分辨率幅值与相位判别器(MRAD/MRPD)用于建模复杂的幅相转换统计特性。通过在每个判别器中使用深度可分离卷积,NDSI-BWE实现参数量减少八倍。生成器采用基于复数的ConformerNeXt架构,结合双流Lattice-Net结构,同时优化幅度与相位。该生成器融合Transformer的全局依赖建模能力与ConvNeXt块的局部时序建模优势。在六项客观评估指标及包含五名人工听评员的主观测试中,NDSI-BWE均取得当前最优表现。
原文摘要 · Abstract (English)
Recovering high-frequency components lost to bandwidth constraints is crucial for applications ranging from telecommunications to high-fidelity audio on limited resources. We introduce NDSI-BWE, a new adversarial Band Width Extension (BWE) framework that leverage four new discriminators inspired by nonlinear dynamical system to capture diverse temporal behaviors: a Multi-Resolution Lyapunov Discriminator (MRLD) for determining sensitivity to initial conditions by capturing deterministic chaos, a Multi-Scale Recurrence Discriminator (MS-RD) for self-similar recurrence dynamics, a Multi-Scale Detrended Fractal Analysis Discriminator (MSDFA) for long range slow variant scale invariant relationship, a Multi-Resolution Poincaré Plot Discriminator (MR-PPD) for capturing hidden latent space relationship, a Multi-Period Discriminator (MPD) for cyclical patterns, a Multi-Resolution Amplitude Discriminator (MRAD) and Multi-Resolution Phase Discriminator (MRPD) for capturing intricate amplitude-phase transition statistics. By using depth-wise convolution at the core of the convolutional block with in each discriminators, NDSI-BWE attains an eight-times parameter reduction. These seven discriminators guide a complex-valued ConformerNeXt based genetor with a dual stream Lattice-Net based architecture for simultaneous refinement of magnitude and phase. The genertor leverage the transformer based conformer's global dependency modeling and ConvNeXt block's local temporal modeling capability. Across six objective evaluation metrics and subjective based texts comprises of five human judges, NDSI-BWE establishes a new SoTA in BWE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。