用智能体整合用户行为与多模态信息,提升推荐准确性
Agents as Knowledge Integrator and Utilizer in Multimodal Recommendation

- 设计双角色智能体:整合器提炼用户偏好与物品属性,利用者基于知识记忆优化图结构和排序
- 在三个Amazon数据集上,召回率和NDCG均优于主流基线,冷启动场景下表现稳健
- 适合需要高精度推荐、多模态融合的工业级应用,可迁移至现有推荐模型
在线平台越来越依赖多模态推荐系统对商品、媒体等内容进行排序。现有方法通常将视觉和文本特征注入物品表征,或从模态级相似性构建同质图,但生成信号与推荐目标仍存在语义偏差。本文从知识融合视角研究该问题:多模态内容应在结合用户行为后,才用于构建推荐图或调整排序。提出AgentMMRec,一种基于智能体的多模态推荐框架,包含两个协同角色。整合器智能体从训练交互和物品内容中推断行为-多模态感知的用户偏好与物品属性,并存入可复用的知识记忆。利用者智能体消费该记忆,优化模态特定的物品-物品图,构建行为感知的同质图,并在冻结评估记忆下重排候选列表。此设计区别于直接大模型特征增强或纯大模型重排序,因生成知识先转化为图结构与模型表示再用于推荐。在三个Amazon多模态推荐数据集上的实验表明,AgentMMRec持续优于近期多模态基线,在稀疏性和物品冷启动场景下依然有效,并能将构建的知识迁移到现有骨干模型。
原文摘要 · Abstract (English)
Online platforms increasingly rely on multimodal recommender systems to rank products, media, and other Web content. Existing methods usually inject visual and textual features into item representations or build homogeneous graphs from modality-level similarity, but the resulting signals can remain misaligned with the recommendation objective. We study this semantic gap from a knowledge-integration perspective: multimodal content should be interpreted together with user behavior before it is used to construct recommendation graphs or adjust rankings. We propose AgentMMRec, an agent-based multimodal recommendation framework with two coordinated roles. The Integrator Agent infers behavior- and multimodal-aware user preferences and item properties from training interactions and item content, then stores them in a reusable knowledge memory. The Utilizer Agent consumes this memory to refine modality-specific item-item graphs, construct behavior-aware homogeneous graphs, and rerank candidate lists under a frozen evaluation-time memory. This design differs from direct LLM feature augmentation and pure LLM reranking because the generated knowledge is first converted into graph structure and model representations before recommendation. Experiments on three Amazon multimodal recommendation datasets show that AgentMMRec consistently improves Recall and NDCG over recent multimodal baselines, remains effective under sparsity and item cold-start settings, and can transfer its constructed knowledge to existing backbones.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。