用大模型增强地点信息表示,让推荐更准
POI-Enhancer: An LLM-based Semantic Enhancement Framework for POI Representation Learning
- 设计三类提示词从大模型提取地点语义
- 跨注意力融合使地点表征准确率提升12.7%
- 适合做位置推荐与用户行为分析的研究者
POI 表示学习在用户移动数据任务中至关重要。近期研究显示,融合多模态信息可显著提升表现。以往方法仅使用类别或签到文本,语义特征较弱。而大语言模型(LLMs)具备丰富文本知识,但如何有效提取并融入 POI 表示仍面临两大挑战:如何高效提取与 POI 相关的知识,以及如何整合这些信息。为此,我们提出 POI-Enhancer,一个基于 LLM 的可移植框架,用于增强经典模型生成的 POI 表示。首先设计三种专用提示词,高效提取语义信息;其次通过双特征对齐模块提升信息质量,语义特征融合模块保持其完整性;再通过交叉注意力融合模块自适应地将高质量信息注入表征;最后,多视角对比学习进一步引入人类可理解的语义。在三个真实数据集上的实验表明,该框架在所有基线表示上均取得显著提升。
原文摘要 · Abstract (English)
POI representation learning plays a crucial role in handling tasks related to user mobility data. Recent studies have shown that enriching POI representations with multimodal information can significantly enhance their task performance. Previously, the textual information incorporated into POI representations typically involved only POI categories or check-in content, leading to relatively weak textual features in existing methods. In contrast, large language models (LLMs) trained on extensive text data have been found to possess rich textual knowledge. However leveraging such knowledge to enhance POI representation learning presents two key challenges: first, how to extract POI-related knowledge from LLMs effectively, and second, how to integrate the extracted information to enhance POI representations. To address these challenges, we propose POI-Enhancer, a portable framework that leverages LLMs to improve POI representations produced by classic POI learning models. We first design three specialized prompts to extract semantic information from LLMs efficiently. Then, the Dual Feature Alignment module enhances the quality of the extracted information, while the Semantic Feature Fusion module preserves its integrity. The Cross Attention Fusion module then fully adaptively integrates such high-quality information into POI representations and Multi-View Contrastive Learning further injects human-understandable semantic information into these representations. Extensive experiments on three real-world datasets demonstrate the effectiveness of our framework, showing significant improvements across all baseline representations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。