让大模型可靠执行复杂拓扑数据分析流程,错误率低于1%。
TopoPilot: Reliable Conversational Workflow Automation for Topological Data Analysis and Visualization
- 双代理架构:一个负责规划,一个负责验证,确保每步操作合法
- 在100个提示、1000次对话中成功率达99%以上,远超基线
- 专为科学可视化设计,可扩展至其他领域,适合科研自动化
近期的智能体系统表明,大型语言模型可从自然语言生成科学可视化结果。然而,可靠性仍是主要瓶颈:系统可能执行无效操作、引入细微但关键的错误,或在输入不完整时未主动询问缺失信息。这些问题在真实工作流中尤为突出,其复杂性远超标准基准。因此,确保自主可视化流水线的可靠性仍是一大挑战。本文提出TopoPilot,一个可靠且可扩展的智能体框架,用于自动化复杂科学可视化流程。该框架通过系统化防护机制和验证手段保障运行可靠性。尽管聚焦于拓扑数据分析与可视化,但其设计具备跨领域泛化能力。TopoPilot采用以可靠性为中心的双代理架构:协调代理将用户提示转化为由原子后端操作组成的流程,验证代理在执行前评估流程,确保结构有效性与语义一致性。这种解析与验证分离的设计降低了代码生成错误,并提供正确性保证。模块化架构进一步提升鲁棒性,通过隔离组件实现新描述符与领域特定流程的无缝集成,无需修改核心系统。为系统性解决可靠性问题,我们提出故障模式分类体系,并对每类实施针对性防护。在模拟100个提示、1000次多轮对话的评估中(含对抗性与不可行请求),TopoPilot成功率超过99%,而缺乏全面防护的基线系统成功率不足50%。
原文摘要 · Abstract (English)
Recent agentic systems demonstrate that large language models can generate scientific visualizations from natural language. However, reliability remains a major limitation: systems may execute invalid operations, introduce subtle but consequential errors, or fail to request missing information when inputs are underspecified. These issues are amplified in real-world workflows, which often exceed the complexity of standard benchmarks. Ensuring reliability in autonomous visualization pipelines therefore remains an open challenge. We present TopoPilot, a reliable and extensible agentic framework for automating complex scientific visualization workflows. TopoPilot incorporates systematic guardrails and verification mechanisms to ensure reliable operation. While we focus on topological data analysis and visualization as a primary use case, the framework is designed to generalize across visualization domains. TopoPilot adopts a reliability-centered two-agent architecture. An orchestrator agent translates user prompts into workflows composed of atomic backend actions, while a verifier agent evaluates these workflows prior to execution, enforcing structural validity and semantic consistency. This separation of interpretation and verification reduces code-generation errors and enforces correctness guarantees. A modular architecture further improves robustness by isolating components and enabling seamless integration of new descriptors and domain-specific workflows without modifying the core system. To systematically address reliability, we introduce a taxonomy of failure modes and implement targeted safeguards for each class. In evaluations simulating 1,000 multi-turn conversations across 100 prompts, including adversarial and infeasible requests, TopoPilot achieves a success rate exceeding 99%, compared to under 50% for baselines without comprehensive guardrails and checks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。