arXiv:2506.04852cs.SDcs.HC2025-06

让用户评分指导模型迭代,让AI音乐更懂人心。

Improving AI-generated music with user-guided training

  • 用用户评分作为损失函数,通过人机协作优化音乐生成模型。
  • 首轮迭代平均评分提升0.2,第二轮再增0.39,性能持续改善。
  • 适合关注个性化音乐生成与人机交互的创作者和研究者。

AI音乐生成已取得显著进展,扩散模型与自回归算法能生成高保真音乐,支持风格变换、乐器混合或分离。由于声音可表示为频谱图,图像生成算法可用于创作新音乐。然而,这些模型通常基于固定数据集训练,难以准确理解并响应用户输入。音乐具有高度主观性,需个性化表达,而图像生成无需此类定制。为此,本文提出一种人机协作方法,通过聚合用户评分作为损失函数,对初始固定数据集训练的模型进行微调。采用遗传算法结合用户反馈,逐步提升模型表现。实验显示,首轮迭代平均评分较基线提升0.2;第二轮进一步提升0.39,验证了该方法的有效性。

原文摘要 · Abstract (English)

AI music generation has advanced rapidly, with models like diffusion and autoregressive algorithms enabling high-fidelity outputs. These tools can alter styles, mix instruments, or isolate them. Since sound can be visualized as spectrograms, image-generation algorithms can be applied to generate novel music. However, these algorithms are typically trained on fixed datasets, which makes it challenging for them to interpret and respond to user input accurately. This is especially problematic because music is highly subjective and requires a level of personalization that image generation does not provide. In this work, we propose a human-computation approach to gradually improve the performance of these algorithms based on user interactions. The human-computation element involves aggregating and selecting user ratings to use as the loss function for fine-tuning the model. We employ a genetic algorithm that incorporates user feedback to enhance the baseline performance of a model initially trained on a fixed dataset. The effectiveness of this approach is measured by the average increase in user ratings with each iteration. In the pilot test, the first iteration showed an average rating increase of 0.2 compared to the baseline. The second iteration further improved upon this, achieving an additional increase of 0.39 over the first iteration.

音乐生成人机交互用户反馈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。