用感知特征控制旋律和声生成,提升音乐表达与创意。
A Controllable Perceptual Feature Generative Model for Melody Harmonization via Conditional Variational Autoencoder
- 基于条件变分自编码器,通过感知特征预测实现可控和声生成。
- 在BCPT-220K数据集上达到当前最优的感知特征预测性能。
- 适合关注音乐生成创造性与表达力的研究者与作曲实践者。
尽管大语言模型使符号化音乐生成更易获取,但创作出具有独特风格和丰富表现力的音乐仍是重大挑战。现有方法多引入情感模型引导生成,但仍缺乏新颖性与创造力。在音乐信息检索领域,听觉感知被视为音乐体验的关键维度,可揭示作曲意图与情感模式。为此,我们提出一种名为CPFG-Net的神经网络,结合将感知特征映射为和弦表示的转换算法,实现旋律和声生成。该系统可从给定旋律中可控预测感知特征序列与调性结构,并生成和声连贯的和弦进行。模型在新构建的感知特征数据集BCPT-220K(源自古典音乐)上训练,实验表明其在感知特征预测方面达到业界领先水平,并展现出出色的音乐表现力与创造力。本工作为旋律和声提供了新视角,可推广至更广泛的音乐生成任务。该符号化模型易于扩展至音频基模型。
原文摘要 · Abstract (English)
While Large Language Models (LLMs) make symbolic music generation increasingly accessible, producing music with distinctive composition and rich expressiveness remains a significant challenge. Many studies have introduced emotion models to guide the generative process. However, these approaches still fall short of delivering novelty and creativity. In the field of Music Information Retrieval (MIR), auditory perception is recognized as a key dimension of musical experience, offering insights into both compositional intent and emotional patterns. To this end, we propose a neural network named CPFG-Net, along with a transformation algorithm that maps perceptual feature values to chord representations, enabling melody harmonization. The system can controllably predict sequences of perceptual features and tonal structures from given melodies, and subsequently generate harmonically coherent chord progressions. Our network is trained on our newly constructed perceptual feature dataset BCPT-220K, derived from classical music. Experimental results show state-of-the-art perceptual feature prediction capability of our model as well as demonstrate our musical expressiveness and creativity in chord inference. This work offers a novel perspective on melody harmonization and contributes to broader music generation tasks. Our symbolic-based model can be easily extended to audio-based models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。