arXiv:2411.14972eess.AScs.AI2024-11被引 6

用众包神经网络模拟吉他效果器,生成大规模音效数据集。

Open-Amp: Synthetic Data Framework for Audio Effect Foundation Models

  • 众包用户创建开源音效软件的神经网络模拟器
  • 训练后在多任务分类中达新最优性能
  • 可泛化到未见的模拟音效设备,适合音乐处理研究者

本文提出 Open-Amp,一个用于生成大规模多样化音效数据的合成数据框架。音效对音乐音频处理与音乐信息检索(MIR)任务至关重要,如模拟模拟音效、自动混音、音色匹配与转录等。现有音效数据集范围有限,通常仅包含少量音效处理器和输入音频信号。Open-Amp 通过众包方式获取开源音效模拟软件用户的神经网络音效模拟器,使用户可完全控制输入信号,并提供数百个高质量设备的模拟。该框架支持训练时在线渲染音频,极大增强数据增强灵活性。实验表明,使用 Open-Amp 训练的吉他音效编码器在多个分类任务上达到新最优性能;此外,基于 Open-Amp 训练的一对多吉他音效模型,可通过操控学习的潜在空间模拟未见的模拟音效,证明其对真实模拟音效数据具有迁移能力。

原文摘要 · Abstract (English)

This paper introduces Open-Amp, a synthetic data framework for generating large-scale and diverse audio effects data. Audio effects are relevant to many musical audio processing and Music Information Retrieval (MIR) tasks, such as modelling of analog audio effects, automatic mixing, tone matching and transcription. Existing audio effects datasets are limited in scope, usually including relatively few audio effects processors and a limited amount of input audio signals. Our proposed framework overcomes these issues, by crowdsourcing neural network emulations of guitar amplifiers and effects, created by users of open-source audio effects emulation software. This allows users of Open-Amp complete control over the input signals to be processed by the effects models, as well as providing high-quality emulations of hundreds of devices. Open-Amp can render audio online during training, allowing great flexibility in data augmentation. Our experiments show that using Open-Amp to train a guitar effects encoder achieves new state-of-the-art results on multiple guitar effects classification tasks. Furthermore, we train a one-to-many guitar effects model using Open-Amp, and use it to emulate unseen analog effects via manipulation of its learned latent space, indicating transferability to analog guitar effects data.

音效生成合成数据音乐信息检索神经网络模拟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。