通过分解频域信号空间,实现更清晰的语音合成模型。
Learning Neural Vocoder from Range-Null Space Decomposition
- 将信号分解为范围空间与零空间,分别处理频谱主结构与细节。
- 在LJSpeech和LibriTTS上达到当前最优性能,参数量更少。
- 适合关注可解释性与轻量化语音合成的研究者。
尽管近年来神经声码器发展迅速,但仍面临建模不透明、参数与性能难平衡等固有挑战。本文提出一种基于时频域的新方法,将经典信号范围-零空间分解(RND)理论引入声码器任务。目标频谱的重建被分解为范围空间与零空间的叠加:前者通过从原始梅尔刻度到目标线性刻度的线性变换实现,后者则由可学习网络生成更精细的频谱细节。为此,我们设计了一种双路径框架,对频谱进行分层编码/解码,并引入跨带与窄带模块以高效建模子带与序列信息。在LJSpeech和LibriTTS数据集上的实验表明,该方法在保持轻量参数的同时,性能优于现有先进方法。代码与预训练模型已开源。
原文摘要 · Abstract (English)
Despite the rapid development of neural vocoders in recent years, they usually suffer from some intrinsic challenges like opaque modeling, and parameter-performance trade-off. In this study, we propose an innovative time-frequency (T-F) domain-based neural vocoder to resolve the above-mentioned challenges. To be specific, we bridge the connection between the classical signal range-null decomposition (RND) theory and vocoder task, and the reconstruction of target spectrogram can be decomposed into the superimposition between the range-space and null-space, where the former is enabled by a linear domain shift from the original mel-scale domain to the target linear-scale domain, and the latter is instantiated via a learnable network for further spectral detail generation. Accordingly, we propose a novel dual-path framework, where the spectrum is hierarchically encoded/decoded, and the cross- and narrow-band modules are elaborately devised for efficient sub-band and sequential modeling. Comprehensive experiments are conducted on the LJSpeech and LibriTTS benchmarks. Quantitative and qualitative results show that while enjoying lightweight network parameters, the proposed approach yields state-of-the-art performance among existing advanced methods. Our code and the pretrained model weights are available at https://github.com/Andong-Li-speech/RNDVoC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。