用多模态特征提升音乐推荐,尤其改善冷启动问题。
Revisiting Content-Based Music Recommendation: Efficient Feature Aggregation from Large-Scale Music Models

- 融合音频与文本模态,用大模型提取音色特征
- 新方法MuQ-token让多层音频特征更高效整合,效果更优
- 适合做内容驱动推荐或跨模态研究的学者
音乐推荐系统是现代流媒体平台的核心。现有模型多依赖协同过滤,忽略音频内在特性,导致冷启动场景下表现不佳。现有数据集常缺乏原始音频和文本描述等多模态信息,且评估框架不支持多样化算法,尤其难适配多模态方法。为此,我们提出TASTE——一个集成音频与文本模态的综合数据集与基准测试框架。基于大规模自监督音乐编码器,我们验证了提取的音频表示在候选召回和点击率预测任务中的显著价值。此外,我们提出 extbf{MuQ-token}方法,实现多层音频特征的高效融合,其性能在多种设置下均优于其他特征整合方式。结果不仅证实内容驱动方法的有效性,还为未来研究提供了可复用的多模态基础。代码已开源。
原文摘要 · Abstract (English)
Music Recommendation Systems (MRSs) are a cornerstone of modern streaming platforms. Existing recommendation models, spanning both recall and ranking stages, predominantly rely on collaborative filtering, which fails to exploit the intrinsic characteristics of audio and consequently leads to suboptimal performance, particularly in cold-start scenarios. However, existing music recommendation datasets often lack rich multimodal information, such as raw audio signals and descriptive textual metadata. Moreover, current recommender system evaluation frameworks remain inadequate, as they neither fully leverage multimodal information nor support a diverse range of algorithms, especially multimodal methods. To address these limitations, we propose TASTE, a comprehensive dataset and benchmarking framework designed to highlight the role of multimodal information in music recommendation. Our dataset integrates both audio and textual modalities. By leveraging recent large-scale self-supervised music encoders, we demonstrate the substantial value of the extracted audio representations across recommendation tasks, including candidate recall and CTR. In addition, we introduce the \textbf{MuQ-token} method, which enables more efficient integration of multi-layer audio features. This method consistently outperforms other feature integration techniques across various settings. Overall, our results not only validate the effectiveness of content-driven approaches but also provide a highly effective and reusable multimodal foundation for future research. Code is available at https://github.com/zreach/TASTE
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。