arXiv:2501.18470eess.AScs.LG2025-01中稿 · publication in IEE…被引 4

提出新型重采样滤波器,实现音频效果模型的实时采样率自适应。

Resampling Filter Design for Multirate Neural Audio Effect Processing

  • 在神经网络输入输出端实时重采样,替代模型结构调整。
  • 两级滤波设计每样本运算少于1毫秒延迟,性能优于旧方法。
  • 适合需要高精度采样率转换的音乐效果建模场景。

神经网络已广泛用于音频效果建模,尤其在吉他放大器和失真踏板中。但这类模型的训练采样率被隐式编码于权重中,推理时难以调整。已有研究通过修改循环神经网络结构实现采样率无关性,适用于整数倍上采样,可减少非线性激活带来的混叠。对于小幅度分数采样率变化,分数延时滤波器虽可近似,但有时完全失效。本文提出在神经网络输入输出端进行实时信号重采样作为替代方案。我们评估多种重采样滤波器设计,发现由半带IIR滤波器与凯泽窗FIR滤波器级联的两阶段设计,在相同或更优性能下,每样本运算量更少,延迟低于1毫秒(典型音频速率)。此外,我们还研究了整数上采样的插值与抽取滤波器,证明级联半带IIR与FIR设计可与模型调整法结合,有效降低多种失真效果模型中的混叠现象。

原文摘要 · Abstract (English)

Neural networks have become ubiquitous in audio effects modelling, especially for guitar amplifiers and distortion pedals. One limitation of such models is that the sample rate of the training data is implicitly encoded in the model weights and therefore not readily adjustable at inference. Recent work explored modifications to recurrent neural network architecture to approximate a sample rate independent system, enabling audio processing at a rate that differs from the original training rate. This method works well for integer oversampling and can reduce aliasing caused by nonlinear activation functions. For small fractional changes in sample rate, fractional delay filters can be used to approximate sample rate independence, but in some cases this method fails entirely. Here, we explore the use of real-time signal resampling at the input and output of the neural network as an alternative solution. We investigate several resampling filter designs and show that a two-stage design consisting of a half-band IIR filter cascaded with a Kaiser window FIR filter can give similar or better results to the previously proposed model adjustment method with many fewer filtering operations per sample and less than one millisecond of latency at typical audio rates. Furthermore, we investigate interpolation and decimation filters for the task of integer oversampling and show that cascaded half-band IIR and FIR designs can be used in conjunction with the model adjustment method to reduce aliasing in a range of distortion effect models.

音频处理神经网络重采样滤波器设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。