让推荐更贴近真实位置,通过空间感知提升大规模地点推荐效果
SPAR: Enhancing Industrial-Scale Generative POI Recommendation via Real-World Spatial Perception

- 用坐标嵌入生成兼具语义与地理一致性的地点标识符
- 在25个地理数据集上预训练模型,构建连贯的城市空间认知
- 冻结空间知识向量防止遗忘,适合工业级位置服务场景
生成式地点推荐(POI)通过自回归生成目标地点的语义ID(SID),在基于位置的服务中具有巨大潜力。然而,现有方法仅依赖行为序列和协同信号定义兴趣空间,地理信息仅作为SID的文本属性,缺乏对距离、方向和可达性的显式建模,导致推荐虽符合行为逻辑但远离用户实时位置。本文提出SPAR框架,通过三个协同阶段融合真实城市空间知识:(1) 在标记化层面,空间内生的SID(SI-SID)将经纬度编码为正弦地理嵌入,并与语义嵌入融合,经RQ-Kmeans生成同时具备语义与地理一致性的标识符;(2) 在认知层面,多粒度地理空间CPT(MG-CPT)在25个精心筛选的地理数据集上,按基础属性、成对关系、城市级导航三层次持续预训练基础大模型,使分散的地点形成连贯的城市空间;(3) 在适配层面,任务向量锚定微调(TV-SFT)将习得的空间知识以冻结参数向量形式锚定,防止在行为微调中发生灾难性遗忘,实现兴趣空间与地理空间的融合。在两个公开及四个工业级数据集上的定量与可视化实验验证了SPAR的有效性。
原文摘要 · Abstract (English)
Generative Point-of-Interest (POI) recommendation, autoregressively generating a target POI's semantic ID (SID), holds great promise for Location-Based Services, where a recommendation helps only if the user can reach it. Yet, existing methods operate within an interest space defined by behavior sequences and collaborative signals, where geography enters only as a textual attribute of the SID, leaving no explicit mechanism to learn or preserve how urban places are related by distance, direction, and reachability; their predictions are thus behaviorally plausible yet far from the user's real-time location. We argue that such services require injecting real urban spatial knowledge into the interest space, rather than inferring geography from behavior alone. Hence, we propose SPAR, a unified framework whose three synergistic stages jointly construct, cultivate, and preserve urban spatial knowledge: (1) at the tokenization level, Spatially-Intrinsic SID (SI-SID) explicitly encodes longitude--latitude coordinates into a sinusoidal geospatial embedding and fuses it with the textual semantic embedding, producing identifiers via RQ-Kmeans that are simultaneously semantically and geographically consistent; (2) at the cognition level, Multi-Granular Geospatial CPT (MG-CPT) continually pre-trains the base LLM on 25 curated geospatial datasets organized into three tiers of basic attributes, pairwise relations, and city-scale navigation, so that scattered POIs cohere into a connected urban space; and (3) at the adaptation level, Task-Vector Anchored SFT (TV-SFT) anchors the acquired spatial knowledge as a frozen parameter-space task vector to prevent its catastrophic forgetting during behavioral fine-tuning, thereby fusing the two spaces. Extensive quantitative and visualization experiments on two public and four industrial-scale datasets demonstrate the effectiveness of SPAR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。