arXiv:2505.21512cs.LGcs.HC2025-05被引 3

可视化让大模型生成的图谱查询更可信,但可能引发错误信任。

The Role of Visualization in LLM-Assisted Knowledge Graph Systems: Effects on User Trust, Exploration, and Workflows

  • 用自然语言提问转为结构化查询,配合五种可视化机制辅助理解
  • 专家用户因界面友好过度信任错误结果,存在误判风险
  • 适合设计交互式图谱分析工具的研究者与开发者参考

知识图谱(KG)虽强大,但探索仍具挑战,即使对专家亦然。大语言模型(LLM)被广泛用于缓解此问题,但其与图谱结合如何影响用户信任、探索行为及决策尚缺乏实证研究。为此,我们开发了LinkQ系统,利用LLM将自然语言问题转化为结构化查询。通过与14位图谱专家合作,设计了五种可视化机制:展示系统当前处理阶段的LLM-KG状态图、显示生成查询与模型解释的查询编辑器、包含实体关系及其语义描述的实体-关系ID表、描绘知识图谱遍历路径的查询结构图,以及交互式查询结果图。定性评估发现,用户——包括专家——因可视化“友好”而过度信任输出,即使模型出错。用户的工作流受其对图谱和大模型熟悉程度影响,揭示系统并非普适适用。研究警示了在大模型辅助分析中虚假信任的风险,强调需进一步探究可视化作为缓解手段的作用。

原文摘要 · Abstract (English)

Knowledge graphs (KGs) are powerful data structures, but exploring them effectively remains difficult for even expert users. Large language models (LLMs) are increasingly used to address this gap, yet little is known empirically about how their usage with KGs shapes user trust, exploration strategies, or downstream decision-making - raising key design challenges for LLM-based KG visual analysis systems. To study these effects, we developed LinkQ, a KG exploration system that converts natural language questions into structured queries with an LLM. We collaborated with KG experts to design five visual mechanisms that help users assess the accuracy of both KG queries and LLM responses: an LLM-KG state diagram that illustrates which stage of the exploration pipeline LinkQ is in, a query editor displaying the generated query paired with an LLM explanation, an entity-relation ID table showing extracted KG entities and relations with semantic descriptions, a query structure graph that depicts the path traversed in the KG, and an interactive graph visualization of query results. From a qualitative evaluation with 14 practitioners, we found that users - even KG experts - tended to overtrust LinkQ's outputs due to its "helpful" visualizations, even when the LLM was incorrect. Users exhibited distinct workflows depending on their prior familiarity with KGs and LLMs, challenging the assumption that these systems are one-size-fits-all - despite often being designed as if they are. Our findings highlight the risks of false trust in LLM-assisted data analysis tools and the need for further investigation into the role of visualization as a mitigation technique.

知识图谱大模型可视化用户信任

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。