arXiv:2509.12350cs.IR2025-09

用知识图谱增强推荐,让大模型更懂用户行为。

Knowledge Graph Tokenization for Behavior-Aware Generative Next POI Recommendation

  • 构建知识图谱结构,用节点ID编码多元信息
  • 多行为学习提升模型对出行意图的理解能力
  • 适合做个性化推荐与智能导航的开发者

生成式推荐范式,尤其是基于大语言模型(LLMs)的方法,已成为下一个兴趣点(POI)推荐的新方向。现有研究通常采用两阶段流程:先通过分词器将POI转换为离散标识符以供LLM处理,再通过指令微调实现推荐。然而仍存在两大局限:一是现有分词器难以编码推荐数据中的异构信号,导致信息丢失;二是以往指令微调仅关注用户的POI访问行为,忽略其他行为类型,限制了对移动行为的全面理解。为此,我们提出KGTB(Knowledge Graph Tokenization for Behavior-aware generative next POI recommendation)。具体而言,KGTB将推荐数据组织为知识图谱(KG)格式,其结构可无缝保留异构信息;进而设计基于知识图谱的分词器,将每个节点量化为独立的结构化ID,该过程受知识图谱结构监督,有效减少信息损失。利用生成的ID,KGTB提出多行为学习框架,引入多个特定行为预测任务用于LLM微调,如POI、类别和区域访问行为。在四个真实城市数据集上的实验表明,KGTB显著优于现有方法。

原文摘要 · Abstract (English)

Generative paradigm, especially powered by Large Language Models (LLMs), has emerged as a new solution to the next point-of-interest (POI) recommendation. Pioneering studies usually adopt a two-stage pipeline, starting with a tokenizer converting POIs into discrete identifiers that can be processed by LLMs, followed by POI behavior prediction tasks to instruction-tune LLM for next POI recommendation. Despite of remarkable progress, they still face two limitations: (1) existing tokenizers struggle to encode heterogeneous signals in the recommendation data, suffering from information loss issue, and (2) previous instruction-tuning tasks only focus on users' POI visit behavior while ignore other behavior types, resulting in insufficient understanding of mobility. To address these limitations, we propose KGTB (Knowledge Graph Tokenization for Behavior-aware generative next POI recommendation). Specifically, KGTB organizes the recommendation data in a knowledge graph (KG) format, of which the structure can seamlessly preserve the heterogeneous information. Then, a KG-based tokenizer is developed to quantize each node into an individual structural ID. This process is supervised by the KG's structure, thus reducing the loss of heterogeneous information. Using generated IDs, KGTB proposes multi-behavior learning that introduces multiple behavior-specific prediction tasks for LLM fine-tuning, e.g., POI, category, and region visit behaviors. Learning on these behavior tasks provides LLMs with comprehensive insights on the target POI visit behavior. Experiments on four real-world city datasets demonstrate the superior performance of KGTB.

推荐系统知识图谱大模型行为建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。