区分用户熟悉与不熟悉区域,提升轨迹中下一个兴趣点预测准确率。
MoE-TransMov: A Transformer-based Model for Next POI Prediction in Familiar & Unfamiliar Movements
- 采用MoE-Transformer架构,动态选择适合当前移动场景的专家网络。
- 在纽约和京都数据集上,Top-1/Top-5/Top-10准确率及MRR均显著优于基线。
- 适用于需个性化推荐的LBS系统,尤其对跨区域出行场景优化明显。
精准预测人类移动轨迹中的下一个兴趣点(POI)对位置服务至关重要,可实现更及时、个性化的推荐。研究表明,用户在熟悉与不熟悉区域的POI选择行为存在差异,因此需将用户熟悉度纳入模型。现有方法多忽略此区别。本文提出MoE-TransMov,基于Transformer的混合专家(MoE)架构,统一建模不同移动上下文下的轨迹模式,无需为特定数据单独训练。利用用户签到数据,将移动划分为熟悉与不熟悉两类,并构建专用专家网络。通过自注意力机制与自适应门控网络,动态选择最相关专家。在两个真实数据集(小规模开放的Foursquare NYC与大规模京都数据集,由LY Corporation收集)上的实验表明,该模型在Top-1、Top-5、Top-10准确率及均倒数排名(MRR)上均显著超越当前最优基线。结果证明,该方法能有效提升不同移动情境下的预测性能,增强推荐系统的个性化能力,推动城市应用发展。
原文摘要 · Abstract (English)
Accurate prediction of the next point of interest (POI) within human mobility trajectories is essential for location-based services, as it enables more timely and personalized recommendations. In particular, with the rise of these approaches, studies have shown that users exhibit different POI choices in their familiar and unfamiliar areas, highlighting the importance of incorporating user familiarity into predictive models. However, existing methods often fail to distinguish between the movements of users in familiar and unfamiliar regions. To address this, we propose MoE-TransMov, a Transformer-based model with a Transformer model with a Mixture-of-Experts (MoE) architecture designed to use one framework to capture distinct mobility patterns across different moving contexts without requiring separate training for certain data. Using user-check-in data, we classify movements into familiar and unfamiliar categories and develop a specialized expert network to improve prediction accuracy. Our approach integrates self-attention mechanisms and adaptive gating networks to dynamically select the most relevant expert models for different mobility contexts. Experiments on two real-world datasets, including the widely used but small open-source Foursquare NYC dataset and the large-scale Kyoto dataset collected with LY Corporation (Yahoo Japan Corporation), show that MoE-TransMov outperforms state-of-the-art baselines with notable improvements in Top-1, Top-5, Top-10 accuracy, and mean reciprocal rank (MRR). Given the results, we find that by using this approach, we can efficiently improve mobility predictions under different moving contexts, thereby enhancing the personalization of recommendation systems and advancing various urban applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。