用自然语言对话推荐音乐,兼顾个性与效率。
Just Ask for Music (JAM): Multimodal and Personalized Natural Language Music Recommendation
- 将用户查询与歌曲映射到统一向量空间,通过向量变换实现推荐
- 在10万条对话数据上达到高准确率,支持长期偏好建模
- 轻量设计易集成,适合实际音乐推荐系统部署
自然语言接口为音乐推荐提供了灵活表达复杂偏好的途径。尽管大语言模型在此方向展现潜力,但其在推荐系统中的可扩展性受限于高成本和延迟。基于检索的小型语言模型虽缓解了这些问题,却常依赖单模态项目表示,忽略长期用户偏好,且需重新训练整个模型,难以落地。本文提出JAM(Just Ask for Music),一个轻量、直观的自然语言音乐推荐框架。JAM将用户查询与项目间的交互建模为共享潜在空间中的向量变换,受知识图谱嵌入方法TransE启发。为捕捉音乐与用户意图的复杂性,JAM通过交叉注意力聚合多模态项目特征,并采用稀疏专家混合机制。我们还构建了JAMSessions,一个包含超过10万条用户-查询-项目三元组的新数据集,结合了对话式查询与用户长期偏好,且匿名化处理了用户和项目嵌入。实验表明,JAM能提供精准推荐,生成适合实际应用的直观表示,并可轻松集成至现有音乐推荐系统中。
原文摘要 · Abstract (English)
Natural language interfaces offer a compelling approach for music recommendation, enabling users to express complex preferences conversationally. While Large Language Models (LLMs) show promise in this direction, their scalability in recommender systems is limited by high costs and latency. Retrieval-based approaches using smaller language models mitigate these issues but often rely on single-modal item representations, overlook long-term user preferences, and require full model retraining, posing challenges for real-world deployment. In this paper, we present JAM (Just Ask for Music), a lightweight and intuitive framework for natural language music recommendation. JAM models user-query-item interactions as vector translations in a shared latent space, inspired by knowledge graph embedding methods like TransE. To capture the complexity of music and user intent, JAM aggregates multimodal item features via cross-attention and sparse mixture-of-experts. We also introduce JAMSessions, a new dataset of over 100k user-query-item triples with anonymized user/item embeddings, uniquely combining conversational queries and user long-term preferences. Our results show that JAM provides accurate recommendations, produces intuitive representations suitable for practical use cases, and can be easily integrated with existing music recommendation stacks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。