用大模型让轨迹理解更智能,融合地图图像与文本描述提升分析精度。
TrajSceneLLM: A Multimodal Perspective on Semantic GPS Trajectory Analysis
- 将地图图像与LLM生成的文本结合,构建轨迹语义嵌入。
- 在出行方式识别任务中准确率显著提升,优于传统方法。
- 适合研究城市交通、移动行为分析的学者和工程师使用。
GPS轨迹数据揭示了人类移动与城市动态的重要模式,支持多种空间应用。然而,传统方法在提取深层语义表征和融入上下文地图信息方面存在不足。我们提出TrajSceneLLM,一种多模态框架,用于增强对GPS轨迹的语义理解。该框架整合可视化地图图像(编码空间上下文)与通过大语言模型推理生成的文本描述(捕捉时间序列与运动动态)。每种模态分别生成嵌入,并拼接形成富含语义的轨迹场景嵌入,再与简单MLP分类器配合。我们在出行方式识别(TMI)这一关键任务上验证了该框架,实验表明其嵌入能实现显著性能提升,凸显了大模型驱动方法在捕捉深层时空依赖性及减少手工特征依赖方面的优势。这种语义增强为多样化下游应用与未来地理空间人工智能研究提供了巨大潜力。源代码与数据集公开:https://github.com/februarysea/TrajSceneLLM。
原文摘要 · Abstract (English)
GPS trajectory data reveals valuable patterns of human mobility and urban dynamics, supporting a variety of spatial applications. However, traditional methods often struggle to extract deep semantic representations and incorporate contextual map information. We propose TrajSceneLLM, a multimodal perspective for enhancing semantic understanding of GPS trajectories. The framework integrates visualized map images (encoding spatial context) and textual descriptions generated through LLM reasoning (capturing temporal sequences and movement dynamics). Separate embeddings are generated for each modality and then concatenated to produce trajectory scene embeddings with rich semantic content which are further paired with a simple MLP classifier. We validate the proposed framework on Travel Mode Identification (TMI), a critical task for analyzing travel choices and understanding mobility behavior. Our experiments show that these embeddings achieve significant performance improvement, highlighting the advantage of our LLM-driven method in capturing deep spatio-temporal dependencies and reducing reliance on handcrafted features. This semantic enhancement promises significant potential for diverse downstream applications and future research in geospatial artificial intelligence. The source code and dataset are publicly available at: https://github.com/februarysea/TrajSceneLLM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。