arXiv:2605.09348cs.CLcs.AI2026-05中稿 · LREC2026

构建家用日常活动多模态知识图谱问答数据集,解决真实场景下AI推理难题。

HOME-KGQA: A Benchmark Dataset for Multimodal Knowledge Graph Question Answering on Household Daily Activities

论文配图:HOME-KGQA: A Benchmark Dataset for Multimodal Knowledge Graph Question Answering on Household Daily Activities
图 1 · 摘自论文原文
  • 基于家庭日常活动的多模态知识图谱构建问答数据集
  • 包含需时空推理与多跳查询的复杂问题,挑战现有模型性能
  • 适合研究具身智能、多模态推理与可信AI的学者使用

大型语言模型(LLMs)具备灵活的自然语言处理能力,而知识图谱(KGs)则提供明确且结构化的知识。将二者互补结合,有助于开发可靠且可验证的AI系统。特别是知识图谱问答(KGQA)被视作减少大模型幻觉、利用训练数据之外知识的有效手段。然而,现有KGQA基准数据集偏向百科知识,仅限单一模态,缺乏细粒度时空数据,限制了其在具身AI所关注的真实世界场景中的应用。本文提出HOME-KGQA,一个基于家庭日常活动多模态知识图谱的新型KGQA基准数据集。该数据集包含复杂的多跳自然语言问题,并配以图数据库查询语言。相比现有基准,其问题更具挑战性,涉及多层级时空推理、多模态对齐及聚合函数。实验表明,基于LLM的KGQA方法在HOME-KGQA上的表现远低于在现有数据集上的水平,凸显了实际部署中仍需解决的关键挑战。数据集已开源:https://github.com/aistairc/home-kgqa。

原文摘要 · Abstract (English)

Large Language Models (LLMs) provide flexible natural language processing capabilities, while knowledge graphs (KGs) offer explicit and structured knowledge. Integrating these two in a complementary manner enables the development of reliable and verifiable AI systems. In particular, knowledge graph question answering (KGQA) has attracted attention as a means to reduce LLM hallucinations and to leverage knowledge beyond the training data. However, existing KGQA benchmark datasets are biased toward encyclopedic knowledge, limited to a single modality, and lack fine-grained spatiotemporal data, which limits their applicability to real-world scenarios targeted by Embodied AI. We introduce HOME-KGQA, a novel KGQA benchmark dataset built on a multimodal KG of daily household activities. HOME-KGQA consists of complex, multi-hop natural language questions paired with graph database query languages. Compared to existing benchmarks, it includes more challenging questions that involve multi-level spatiotemporal reasoning, multimodal grounding, and aggregate functions. Experimental results show that the LLM-based KGQA methods fail to achieve performance comparable to that on existing datasets when evaluated on HOME-KGQA. This highlights significant challenges that should be addressed for the real-world deployment of KGQA systems. Our dataset is available at https://github.com/aistairc/home-kgqa

知识图谱多模态具身智能问答系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。