arXiv:2606.26614cs.HCcs.AI2026-06被引 3

让人类与AI协作完成科学可视化,提升控制力与透明度。

HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualization

论文配图:HiLSVA: Design and Evaluation of a Human-in-the-Loop Agentic System for Scientific Visualization
图 1 · 摘自论文原文
  • 采用计划先行的多智能体架构,支持人机混合决策。
  • 用户研究显示协作模式提升任务完成率与流程透明度。
  • 适合需要高可控性的科研人员和可视化开发者。

大语言模型代理为科学可视化(SciVis)提供了自然语言交互能力。然而,现有系统过度强调自主性,削弱了人类的分析控制与透明度。我们提出HiLSVA,一个支持混合主动性工作流的人机协同代理系统。该系统结合先规划的多代理架构、显式的人类监督、分步溯源追踪,以及基于用户反馈的测试时学习自适应机制。通过自然语言和直接操作可视化界面,实现人机流畅切换,沙箱执行确保流程安全可复现。HiLSVA将代理式科学可视化重构为协作过程,增强而非替代人类分析推理。我们通过典型案例研究和包含12名不同专业背景参与者的受控用户实验,在多种自主性设置下评估系统。结果表明,混合主动性交互在不同用户熟练度下均提升任务完成率、用户控制感与流程透明度,同时揭示执行效率与人类监督间的权衡。研究强调了在代理式科学可视化中以人为中心设计的重要性,并为未来协同可视化系统提供指导。演示视频、案例研究及源码详见 https://hilsva.github.io/。

原文摘要 · Abstract (English)

Large language model (LLM) agents enable natural language interaction for scientific visualization (SciVis). Still, prior systems have essentially prioritized autonomy over human analytical control, thereby limiting transparency and human oversight. We present HiLSVA, a human-in-the-loop agentic system that supports mixed-initiative SciVis workflows. HiLSVA integrates a plan-first multi-agent architecture with explicit human oversight, stepwise provenance tracking, and learn-at-test-time adaptation from user feedback. The system supports fluid handoff between humans and agents through both natural language and direct manipulation of visualizations, while sandboxed execution ensures safe, reproducible workflows. In doing so, HiLSVA reframes agentic SciVis as a collaborative process that augments, rather than replaces, human analytical reasoning. We evaluate HiLSVA through representative case studies and a controlled user study with twelve participants of varying expertise across multiple autonomy settings. Results show that mixed-initiative interaction improves task completion, user control, and workflow transparency across different levels of user expertise, while revealing a tradeoff between execution efficiency and human oversight. These findings highlight the importance of human-centered design in agentic SciVis and guide the development of future collaborative visualization systems. We encourage readers to explore our demo video, case studies, and source code at https://hilsva.github.io/.

科学可视化人机协作大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。