用拓扑感知的语义编码和强化学习,让大模型推荐下一个地点更准确且可解释。
Refine-POI: Reinforcement Fine-Tuned Large Language Models for Next Point-of-Interest Recommendation
- 用分层自组织映射生成语义编码,让相近编码对应相似地点。
- 通过强化学习优化前k名推荐列表,避免单一答案固定。
- 适合需要推理与多候选推荐的场景,如智能导航与行程规划。
将大语言模型(LLM)用于下一个兴趣点(POI)推荐面临两大挑战:(i) 现有方法生成的语义ID虽含语义信息,但其拓扑无关的索引方式无法保持语义连续性,即ID值相近不代表语义相关;(ii) 基于监督微调(SFT)的方法仅支持单次输出,导致“答案固化”,难以生成排名列表并进行推理,因标注数据稀缺。本文提出Refine-POI框架,通过拓扑感知的ID生成与强化微调解决上述问题。首先,引入分层自组织映射(SOM)量化策略生成语义ID,确保码本中坐标邻近反映潜在空间的语义相似性。其次,采用策略梯度框架优化前k名推荐列表生成,摆脱对严格标签匹配的依赖。在三个真实世界数据集上的实验表明,Refine-POI显著优于现有基线,有效融合了大模型的推理能力与高精度、可解释的推荐表示。
原文摘要 · Abstract (English)
Advancing large language models (LLMs) for the next point-of-interest (POI) recommendation task faces two fundamental challenges: (i) although existing methods produce semantic IDs that incorporate semantic information, their topology-blind indexing fails to preserve semantic continuity, meaning that proximity in ID values does not mirror the coherence of the underlying semantics; and (ii) supervised fine-tuning (SFT)-based methods restrict model outputs to top-1 predictions. These approaches suffer from "answer fixation" and neglect the need for top-k ranked lists and reasoning due to the scarcity of supervision. We propose Refine-POI, a framework that addresses these challenges through topology-aware ID generation and reinforcement fine-tuning. First, we introduce a hierarchical self-organizing map (SOM) quantization strategy to generate semantic IDs, ensuring that coordinate proximity in the codebook reflects semantic similarity in the latent space. Second, we employ a policy-gradient framework to optimize the generation of top-k recommendation lists, liberating the model from strict label matching. Extensive experiments on three real-world datasets demonstrate that Refine-POI significantly outperforms state-of-the-art baselines, effectively synthesizing the reasoning capabilities of LLMs with the representational fidelity required for accurate and explainable next-POI recommendation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。