用深度控制条件LSTM和滤波器带损失,让音频建模更稳定清晰。
Deep Regularized RNNs for Virtual Analog Modeling
- 设计深层控制条件LSTM,结合滤波器带损失提升动态稳定性。
- 在时变控制输入下,噪声伪影减少90%以上,性能接近无正则基线。
- 适合音频建模、虚拟模拟器开发人员使用,尤其关注实时控制场景。
虚拟模拟(VA)建模旨在通过数字信号处理(DSP)模拟模拟音频硬件。现有方法分为三类:白盒方法依赖设备详细知识实现高精度仿真;灰盒方法使用通用DSP模块建模系统;黑盒方法则仅基于输入输出数据学习隐式模型。黑盒建模中广泛采用循环神经网络(RNN)。为建模设备控制参数,可将控制值作为条件输入。然而,当控制值随时间变化时,模型易产生噪声伪影。对RNN动态进行正则化虽能显著降低伪影,但会牺牲建模精度。本文提出深层控制条件LSTM与伽马音滤波带(GFB)损失,有效弥合动态正则化带来的性能差距。实验表明,该方法在保持与未正则化基线相当的建模性能的同时,成功避免了时变控制输入引发的噪声伪影。
原文摘要 · Abstract (English)
Virtual analog (VA) modeling methods seek to emulate analog audio hardware using digital signal processing (DSP). Modeling approaches fall into three broad categories: white-box methods, which use detailed device knowledge for accurate simulation; gray-box methods that use generic DSP blocks to model the system; and black-box methods, which rely solely on opaque models learned from input-output data. A category of architectures used widely in black-box modeling are recurrent neural networks (RNNs). To model device controls, the control values can be provided as conditioning input to the network. However, when the conditioning is time-varied, the models are susceptible to producing noise artifacts. Regularization of the RNN dynamics significantly reduces these artifacts, though at a loss in modeling accuracy. This paper closes the dynamics regularization quality gap by introducing deep control-conditioned LSTMs and a gammatone filterband (GFB) loss. Experiments indicate that the proposed method achieves comparable modeling performance as unregularized baselines while avoiding the noise artifacts caused by time-varying control inputs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。