arXiv:2607.07108cs.IR2026-07被引 2

让推荐系统同时看图说话,用双轨记忆提升精准度

Seeing and Reflecting: Multimodal Memory-Enhanced Agent Collaboration for Recommendation

论文配图:Seeing and Reflecting: Multimodal Memory-Enhanced Agent Collaboration for Recommendation
图 1 · 摘自论文原文
  • 双轨记忆架构:分别处理语义推理和视觉匹配
  • 在真实场景中显著提升视觉相关推荐效果
  • 适合需要图文理解的个性化推荐场景

基于大语言模型的智能体推荐系统虽能通过自然语言推理建模用户偏好,但受限于文本输入和粗粒度记忆更新,易遗漏视觉信息、受语义噪声干扰并出现偏好漂移。为此,我们提出多模态增强型智能体协作框架MMEACR。该框架采用双轨记忆结构:推理轨由用户与物品记忆智能体维护持续的多模态记忆,并通过属性引导的强化-反思机制更新;匹配轨则从原始交互记录和商品图像构建解耦的多模态嵌入记忆,保留细粒度跨模态信号。两轨通过加权互排名融合集成,生成鲁棒且可解释的推荐结果。在三个真实数据集上的实验表明,MMEACR在多项指标上优于主流的LLM及代理基线,尤其在依赖视觉信息的推荐场景中表现突出。

原文摘要 · Abstract (English)

Large language model (LLM)-based agentic recommender systems show promise in modeling user preferences through natural-language reasoning, yet they remain limited by text-centric inputs and coarse-grained memory updates, making agents prone to missing visual evidence, semantic noise, and preference drift. To address these limitations, we propose MMEACR, a Multimodal Memory-Enhanced Agent Collaboration framework for recommendation. MMEACR introduces a dual-track memory architecture that separates interpretable agent reasoning from fine-grained multimodal matching. In the reasoning track, collaborative User and Item Memory Agents maintain persistent multimodal memories and update them through an attribute-guided reinforcement-and-reflection mechanism. In the matching track, a decoupled multi-modal embedding memory is built from raw interaction narratives and item images to preserve detailed cross-modal signals beyond structured memory updates. The two tracks are integrated through weighted Reciprocal Rank Fusion to produce robust and interpretable rankings. Experiments on three real-world domains show that MMEACR achieves strong overall performance against competitive LLM-based and agent-based baselines, with notable gains in visually grounded recommendation scenarios.

推荐系统多模态智能体协作记忆增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。