将协同过滤与大模型结合,实现动态推荐与可验证解释。
Bridging Collaborative Filtering and Large Language Models with Dynamic Alignment, Multimodal Fusion and Evidence-grounded Explanations
- 用轻量模块实时更新用户偏好,避免重训大模型。
- 融合协同信号、视觉与音频特征,支持多模态输入。
- 生成基于具体行为和属性的自然语言解释,可信可查。
近期研究尝试将大语言模型用于推荐任务,通过将用户交互历史和物品元数据转化为文本提示,由大模型生成排序或推荐结果。一种有前景的方法是通过紧凑的适配器网络将协同过滤知识与大模型表示相连,避免昂贵的微调同时保留两者优势。然而实际中仍存在诸多挑战:协同过滤模型常使用静态快照,难以捕捉快速变化的用户偏好;许多真实物品包含丰富的视觉与音频内容,超出文本描述范围;现有系统难以提供基于具体证据的可信解释。本文提出 model{},通过三项关键创新解决上述问题。我们设计在线适应机制,通过轻量模块持续整合新用户交互,无需重新训练大模型;构建统一表示,无缝融合协同信号与视觉、音频特征,支持部分模态缺失的情况;设计解释系统,将推荐依据于特定协同模式与物品属性,生成用户可验证的自然语言理由。该方法保持冻结基础模型的高效性,仅增加极小计算开销,适用于真实场景部署。
原文摘要 · Abstract (English)
Recent research has explored using Large Language Models for recommendation tasks by transforming user interaction histories and item metadata into text prompts, then having the LLM produce rankings or recommendations. A promising approach involves connecting collaborative filtering knowledge to LLM representations through compact adapter networks, which avoids expensive fine-tuning while preserving the strengths of both components. Yet several challenges persist in practice: collaborative filtering models often use static snapshots that miss rapidly changing user preferences; many real-world items contain rich visual and audio content beyond textual descriptions; and current systems struggle to provide trustworthy explanations backed by concrete evidence. Our work introduces \model{}, a framework that tackles these limitations through three key innovations. We develop an online adaptation mechanism that continuously incorporates new user interactions through lightweight modules, avoiding the need to retrain large models. We create a unified representation that seamlessly combines collaborative signals with visual and audio features, handling cases where some modalities may be unavailable. Finally, we design an explanation system that grounds recommendations in specific collaborative patterns and item attributes, producing natural language rationales users can verify. Our approach maintains the efficiency of frozen base models while adding minimal computational overhead, making it practical for real-world deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。