arXiv:2510.14702cs.AI2025-10被引 3

用语言模型融合认知知识,提升地点推荐准确率。

Cognitive-Aligned Spatio-Temporal Large Language Models For Next Point-of-Interest Prediction

  • 用轨迹数据持续预训练,让模型理解地理与移动规律。
  • 通过监督微调和强化学习对齐人类认知,推荐更符合直觉。
  • 适合需要结合天气、节日等情境的高阶位置推荐场景。

下一个兴趣点(POI)推荐旨在基于用户偏好和历史签到记录预测其下一个目的地,在位置服务中具有重要价值。近期,大语言模型(LLMs)在推荐系统中展现出潜力,以生成方式处理下一POI预测任务。然而,这些模型主要在非结构化文本上预训练,缺乏对结构化地理实体和序列移动模式的原生理解。在工业级应用中,融入世界知识与人类认知(如季节、天气、节假日及用户画像:习惯、职业、偏好)可提升体验并改进性能。为此,我们提出CoAST框架,采用自然语言作为接口,整合世界知识、时空轨迹模式、用户画像和情境信息。CoAST分为两个阶段:(1) 通过在脱敏用户时空轨迹数据上继续预训练,获取推荐知识;(2) 通过监督微调(SFT)和后续强化学习(RL)阶段,对齐认知判断与人类偏好。在多个真实数据集上的离线实验以及在高德地图“猜你去哪儿”首页的在线实验均验证了CoAST的有效性。

原文摘要 · Abstract (English)

The next point-of-interest (POI) recommendation task aims to predict the users' immediate next destinations based on their preferences and historical check-ins, holding significant value in location-based services. Recently, large language models (LLMs) have shown great potential in recommender systems, which treat the next POI prediction in a generative manner. However, these LLMs, pretrained primarily on vast corpora of unstructured text, lack the native understanding of structured geographical entities and sequential mobility patterns required for next POI prediction tasks. Moreover, in industrial-scale POI prediction applications, incorporating world knowledge and alignment of human cognition, such as seasons, weather conditions, holidays, and users' profiles (such as habits, occupation, and preferences), can enhance the user experience while improving recommendation performance. To address these issues, we propose CoAST (Cognitive-Aligned Spatial-Temporal LLMs), a framework employing natural language as an interface, allowing for the incorporation of world knowledge, spatio-temporal trajectory patterns, profiles, and situational information. Specifically, CoAST mainly comprises of 2 stages: (1) Recommendation Knowledge Acquisition through continued pretraining on the enriched spatial-temporal trajectory data of the desensitized users; (2) Cognitive Alignment to align cognitive judgments with human preferences using enriched training data through Supervised Fine-Tuning (SFT) and a subsequent Reinforcement Learning (RL) phase. Extensive offline experiments on various real-world datasets and online experiments deployed in "Guess Where You Go" of AMAP App homepage demonstrate the effectiveness of CoAST.

POI推荐大模型认知对齐时空建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。