根据用户时间行为动态分配多模态权重,提升推荐准确性。
TimeRoute: Time-Aware Modality Routing and Diffusion for Multi-Modal Recommendation

- 用时间感知路由模块为不同用户定制多模态融合比例。
- 在Amazon-Baby上最高提升9.8%(P@20),优于主流基线。
- 适合关注时序变化的多模态推荐场景,如电商、短视频。
多模态推荐系统融合用户-物品交互信号与文本、图像、音频等模态信息,但各类模态的有效性随时间以不同速率变化。例如情人节期间,巧克力购买更依赖包装视觉和背景音乐,而非文字成分。这种‘模态时间尺度不匹配’带来双重挑战:(1)不同时间行为的用户需不同模态占比;(2)过时模态易引入误导信号。本文提出统一扩散模型TimeRoute:时间感知模态路由将用户聚合时间特征映射为个性化模态分布,取代传统全局共享融合权重;扩散图重构器通过FiLM结合双流长短期去噪头,捕捉快慢时变动态,在传播前抑制过时模态边。在TikTok、Amazon-Baby、Amazon-Sports数据集上,平均10次种子实验均显著优于强基线,Recall@K、Precision@K、NDCG@K均有提升,最高达9.8%(Amazon-Baby P@20)。控制归因分析表明,性能提升依赖于所提机制与时间输入:仅提供时间特征给主干网络无收益,随机噪声输入效果等同于移除路由模块。代码已公开。
原文摘要 · Abstract (English)
Multi-modal recommenders fuse user-item interaction signals with item modalities such as text, images, and audio, but the usefulness of each drifts over time and at different rates. For example, around Valentine's Day, chocolate purchases become less driven by textual ingredient cues and more by visual packaging and ambient audio. This \emph{modality time-scale mismatch} gives rise to two coupled challenges: (1) users with different temporal behavior profiles require different modality proportions, and (2) less relevant modalities are more likely to introduce outdated or misleading signals into the recommender. We address both challenges within a unified diffusion-based recommender, \textbf{TimeRoute}. A temporal-aware modal router maps each user's aggregated temporal profile to a personalized modality distribution, replacing the globally shared fusion weights used in prior work. The diffusion-based graph reconstructor is conditioned on the same profile through Feature-wise Linear Modulation (FiLM) with dual-stream long- and short-term denoising heads. This design captures both slowly and rapidly evolving temporal dynamics to suppress outdated modality edges before they enter the propagation graph. Experiments on TikTok, Amazon-Baby, and Amazon-Sports, averaged over 10 seeds, demonstrate consistent improvements over strong baselines across Recall@K, Precision@K, and NDCG@K, reaching up to 9.8\% (P@20 on Amazon-Baby). Controlled attribution studies further show that these gains require both the proposed mechanisms and temporal input: naively granting the backbone the same temporal profile yields no benefit, and feeding the router random noise performs no better than removing the router entirely. Code is available at https://anonymous.4open.science/r/TimeRoute.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。