arXiv:2411.00028cs.CLcs.AI2024-11被引 6

用大模型与知识图谱协同预测城市经济,提升准确性。

Harnessing the Synergy between LLM Agents and Knowledge Graphs for Urban Socioeconomic Prediction

  • 让大模型自动发现城市数据中的关键关联路径
  • 跨任务共享知识使预测准确率显著提升
  • 适合城市规划、政策制定者参考

社会经济预测旨在利用多源城市数据预测区域人口、商业活动等指标,对理解城市发展和辅助决策具有重要意义。现有方法虽借助知识图谱(KG)建模异构城市数据并使用图表示学习进行预测,但依赖人工经验提取任务相关知识,且忽略不同指标间的内在关联,限制了预测精度。本文提出一种大语言模型(LLM)代理与知识图谱协同框架,首先构建城市知识图谱(UrbanKG)并微调嵌入语言模型生成带语义信息的实体嵌入;随后利用LLM推理能力为每类预测任务识别相关元路径,并设计语义引导注意力模块实现基于元路径的知识融合;此外引入跨任务通信机制,在LLM代理与知识图谱层面实现知识共享:不同任务代理协作生成更丰富元路径,各任务嵌入自适应融合。在两个数据集上的实验验证了该协同设计的有效性,为社会经济预测任务间的信息共享提供了新思路。

原文摘要 · Abstract (English)

Socioeconomic prediction aims to leverage various urban data to predict the socioeconomic indicators of regions such as population and commercial activity level, which plays an important role in understanding urban regions and supporting decision-making. Existing studies leverage knowledge graphs (KG) to model heterogeneous urban data, and further apply graph representation learning methods for socioeconomic prediction. However, these approaches heavily rely on heuristic ideas and expertise to extract task-relevant knowledge from diverse data, which may not be optimal for specific tasks. Additionally, they tend to overlook the inherent relationships between different indicators, limiting the prediction accuracy. Motivated by the remarkable abilities of large language models (LLMs), in this work, we propose a synergistic framework of LLM agents and KG, which integrates the reasoning and representation learning on KG with LLM agents. We first construct an urban knowledge graph (UrbanKG) to model multi-sourced urban data and finetune an embedding language model to generate embeddings for KG entities with semantic information. Then we leverage the reasoning power of LLM to identify relevant meta-paths in the UrbanKG for each type of socioeconomic prediction task, and design a semantic-guided attention module for knowledge fusion with meta-paths. Moreover, we introduce a cross-task communication mechanism to further enhance performance by enabling knowledge sharing across tasks at both LLM agent and KG levels. On the one hand, the LLM agents for different tasks collaborate to generate more diverse and comprehensive meta-paths. On the other hand, the embeddings from different tasks are adaptively merged. Experiments on two datasets demonstrate the effectiveness of the synergistic design between LLM and KG, providing insights for information sharing across socioeconomic prediction tasks.

城市预测大模型知识图谱多任务学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。