arXiv:2509.00287cs.AIcs.CY2025-09中稿 · KDD被引 1

用大模型自动整合城市多模态数据,构建事件知识图谱。

SIGMUS: Semantic Integration for Knowledge Graphs in Multimodal Urban Spaces

  • 利用大模型自动识别多源数据与城市事件的语义关联。
  • 成功连接5类数据源与同一时空的事件,连接合理性强。
  • 适合城市智能监控、应急响应系统开发者参考。

现代城市部署了日益多样化的传感器,产生大量多模态数据。这些数据可用于识别和推理城市中的重要事件,如重大突发事件、文化社会活动及自然灾害。然而,由于依赖人工判断来建立事件与多模态数据之间的关系,以及理解事件的构成要素,此类数据常分散于多个来源且难以整合。这些关系和要素对分析事件成因、预测未来事件的规模与强度至关重要。本文提出SIGMUS系统,通过大语言模型(LLMs)获取必要的世界知识,自动识别城市空间中事件与不同模态数据之间的关联,无需依赖人工规则即可组织与事件相关的证据和观测。该系统将信息以知识图谱形式表示,涵盖事件、观测等。实验表明,系统能有效连接5种数据源(新闻文本、监控图像、空气质量、天气数据、交通测量)与同时同地发生的事件。

原文摘要 · Abstract (English)

Modern urban spaces are equipped with an increasingly diverse set of sensors, all producing an abundance of multimodal data. Such multimodal data can be used to identify and reason about important incidents occurring in urban landscapes, such as major emergencies, cultural and social events, as well as natural disasters. However, such data may be fragmented over several sources and difficult to integrate due to the reliance on human-driven reasoning for identifying relationships between the multimodal data corresponding to an incident, as well as understanding the different components which define an incident. Such relationships and components are critical to identifying the causes of such incidents, as well as producing forecasting the scale and intensity of future incidents as they begin to develop. In this work, we create SIGMUS, a system for Semantic Integration for Knowledge Graphs in Multimodal Urban Spaces. SIGMUS uses Large Language Models (LLMs) to produce the necessary world knowledge for identifying relationships between incidents occurring in urban spaces and data from different modalities, allowing us to organize evidence and observations relevant to an incident without relying and human-encoded rules for relating multimodal sensory data with incidents. This organized knowledge is represented as a knowledge graph, organizing incidents, observations, and much more. We find that our system is able to produce reasonable connections between 5 different data sources (new article text, CCTV images, air quality, weather, and traffic measurements) and relevant incidents occurring at the same time and location.

知识图谱多模态城市计算LLM应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。