用大模型理解用户打卡序列中的出行意图和偏好
Mobility-LLM: Learning Visiting Intentions and Travel Preferences from Human Mobility Data with Large Language Models
- 将打卡记录转化为语义文本,让大模型理解出行意图
- 在4个数据集上优于现有方法,显著提升意图识别准确率
- 适合研究位置服务、用户行为建模的学者与工程师
基于位置的服务(LBS)积累了大量通过打卡序列体现的人类移动数据,这些序列蕴含着用户的出行意图与偏好。然而,现有模型分析打卡序列时忽视其语义信息,导致理解不完整。受大语言模型(LLM)在多领域中卓越的语义理解与上下文处理能力启发,我们提出Mobility-LLM框架,利用LLM分析打卡序列以支持多项任务。由于LLM无法直接解析打卡记录,我们将其重构为可读语义形式。具体地,引入访问意图记忆网络(VIMN)捕捉每条记录的意图,并构建人类出行偏好提示共享池(HTPP),引导LLM理解用户偏好。该设计显著增强模型从移动数据中提取和利用语义信息的能力。在四个基准数据集及三个下游任务上的实验表明,本方法显著优于现有模型,验证了Mobility-LLM在提升LBS中人类移动数据理解方面的有效性。
原文摘要 · Abstract (English)
Location-based services (LBS) have accumulated extensive human mobility data on diverse behaviors through check-in sequences. These sequences offer valuable insights into users' intentions and preferences. Yet, existing models analyzing check-in sequences fail to consider the semantics contained in these sequences, which closely reflect human visiting intentions and travel preferences, leading to an incomplete comprehension. Drawing inspiration from the exceptional semantic understanding and contextual information processing capabilities of large language models (LLMs) across various domains, we present Mobility-LLM, a novel framework that leverages LLMs to analyze check-in sequences for multiple tasks. Since LLMs cannot directly interpret check-ins, we reprogram these sequences to help LLMs comprehensively understand the semantics of human visiting intentions and travel preferences. Specifically, we introduce a visiting intention memory network (VIMN) to capture the visiting intentions at each record, along with a shared pool of human travel preference prompts (HTPP) to guide the LLM in understanding users' travel preferences. These components enhance the model's ability to extract and leverage semantic information from human mobility data effectively. Extensive experiments on four benchmark datasets and three downstream tasks demonstrate that our approach significantly outperforms existing models, underscoring the effectiveness of Mobility-LLM in advancing our understanding of human mobility data within LBS contexts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。