建模用户兴趣随时间变化,提升社交推荐精准度
Drift-Aware Multimodal User Representation Learning via Multi-Scale Temporal Modeling and Sparse Mixture-of-Experts

- 用多尺度时序建模融合短期行为与长期偏好
- 通过稀疏专家网络分离并动态选择不同兴趣子空间
- 适合做个性化推荐与用户画像的工程师参考
从嘈杂且随时间演化的社交媒体行为中理解用户偏好极具挑战性,因用户兴趣会随时间漂移,并呈现多尺度时间模式与共存的多样化兴趣。为此,我们提出 DUMoE,一个统一的漂移感知多模态用户表征学习框架。模型包含两部分:(i) 时序动态感知主干网络,整合静态用户资料、短期行为信号与长期依赖关系,生成一致表征;(ii) 稀疏混合专家(MoE)兴趣适配器,通过专家专业化与自适应路由分离多个潜在兴趣,每个专家建模特定兴趣子空间,门控网络为每位用户动态选择并聚合稀疏相关专家。为实现稳定高效优化,我们设计三阶段训练策略,解耦主干学习、专家分化与门控优化。在真实社交媒体数据集上的大量实验表明,DUMoE 在用户兴趣预测与交互预测任务上均持续优于当前最优方法。
原文摘要 · Abstract (English)
Understanding user preferences from noisy and temporally evolving social media behaviors is fundamentally challenging due to interest drift, where user preferences shift across time and exhibit both multi-scale temporal patterns and diverse co-existing interests. To address this, we propose DUMoE, a unified framework for drift-aware multimodal user representation learning. Our model consists of (i) a temporal dynamics-aware backbone that captures and integrates static profiles, short-term behavioral signals, and long-term dependencies into a coherent representation, and (ii) a sparse mixture-of-experts (MoE) interest adapter that disentangles multiple latent interests via expert specialization and adaptive routing. Each expert models a distinct interest subspace, while a gating network dynamically selects and aggregates a sparse subset of relevant experts for each user. To enable stable and effective optimization, we further introduce a three-stage training strategy that decouples backbone learning, expert specialization, and gating optimization. Extensive experiments on real-world social media datasets show that DUMoE consistently outperforms state-of-the-art methods on both user interest prediction and interaction prediction tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。