用双曲空间建模音效链顺序,提升音乐制作中音效排列识别准确率。
Hyperbolic Embeddings for Order-Aware Classification of Audio Effect Chains
- 将音效链视为树结构,用双曲嵌入捕捉其非交换性与指数增长特性。
- 在吉他音色数据上,双曲方法相比欧氏方法显著提升分类准确率。
- 适合需要精确音效顺序理解的音乐生成与音频处理研究者。
音效(AFX)是音乐制作中的关键工具,常以链式组合使用以塑造音色与动态。音效在链中的顺序对最终声音至关重要,尤其当涉及非线性(如失真)或时变处理器(如合唱)时。然而,现有研究多集中于从湿信号中估计音效类型与参数,忽视了顺序信息。为此,本文将音效链识别问题建模为从湿信号中联合估计音效类型与顺序的任务。提出一种基于神经网络的双曲嵌入方法,将湿信号映射至双曲空间并进行分类。由于双曲空间具有指数扩展特性,能更高效表示树状结构数据,而音效链可被建模为以音效为节点、边表示顺序关系的树。该特性使其非常适合建模音效组合的指数增长与非交换性——顺序变化会导致不同最终声音。实验基于吉他音色数据表明,在合适曲率下,所提方法显著优于欧氏空间基线。进一步分析显示,该方法在不同类型音效与不同链长条件下均有效捕捉顺序信息。
原文摘要 · Abstract (English)
Audio effects (AFXs) are essential tools in music production, frequently applied in chains to shape timbre and dynamics. The order of AFXs in a chain plays a crucial role in determining the final sound, particularly when non-linear (e.g., distortion) or time-variant (e.g., chorus) processors are involved. Despite its importance, most AFX-related studies have primarily focused on estimating effect types and their parameters from a wet signal. To address this gap, we formulate AFX chain recognition as the task of jointly estimating AFX types and their order from a wet signal. We propose a neural-network-based method that embeds wet signals into a hyperbolic space and classifies their AFX chains. Hyperbolic space can represent tree-structured data more efficiently than Euclidean space due to its exponential expansion property. Since AFX chains can be represented as trees, with AFXs as nodes and edges encoding effect order, hyperbolic space is well-suited for modeling the exponentially growing and non-commutative nature of ordered AFX combinations, where changes in effect order can result in different final sounds. Experiments using guitar sounds demonstrate that, with an appropriate curvature, the proposed method outperforms its Euclidean counterpart. Further analysis based on AFX type and chain length highlights the effectiveness of the proposed method in capturing AFX order.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。