用结构化表示修复大模型生成实验流程的错误与不确定性。
Managing Uncertainty in LLM-Generated Procedural Knowledge for Virtual Laboratory Planning
- 用领域结构和不确定的步骤样本提取候选规则。
- 将模糊步骤转为可检查的显式约束并修复错误。
- 适合教育虚拟实验、智能流程规划的研究者。
教育类虚拟实验室可使实验培训更具可扩展性、适应性和可及性,尤其在学生难以接触真实实验室设备时。然而,编写新的模拟实验流程成本高昂:教师需描述新设备、定义仪器与材料的交互方式,并指定可在虚拟环境中执行或评估的有效流程。大语言模型可辅助生成详细实验流程,但其输出不能直接作为可执行计划使用,可能遗漏必要操作、顺序错误,或产生逻辑矛盾或与设备不兼容的指令。本文提出一个原型框架,用于管理大模型生成实验知识中的不确定性。该框架通过结构化领域表示和不确定的生成状态转移样本,提取候选流程规则,转化为显式且可检查的约束,并用于修复不确定的流程步骤。尽管研究背景是教育虚拟实验室,但核心问题更广泛:在结构化交互环境中管理不确定的行动规划知识。我们在涉及实验仪器、容器、工具及物料转移动作的虚拟实验室场景中验证了该方法。
原文摘要 · Abstract (English)
Educational virtual laboratories can make experimental training more scala-ble, adaptive, and accessible, especially when students have limited access to physical laboratory facilities. However, authoring new simulated laboratory procedures remains costly: educators must describe new equipment, define how instruments and materials interact, and specify valid procedural flows that can be executed or assessed inside the virtual environment. Large lan-guage models can assist in this authoring process by generating detailed ex-perimental procedures, but their output should not be treated as directly exe-cutable plans. They may omit necessary actions, arrange steps in the wrong order, or produce instructions that are logically incorrect or incompatible with the laboratory equipment. This paper presents a prototype framework for managing uncertainty in LLM-generated procedural knowledge for virtu-al laboratory planning. The framework aims to reduce procedural uncertainty by using structured domain representations and uncertain LLM-generated state-transition samples to extract candidate procedural rules, transform them into explicit and inspectable constraints, and use them to repair uncertain procedural steps. Although the motivating domain refers to educational vir-tual laboratories, the underlying problem is more general: managing uncer-tain procedural knowledge for action planning in structured interactive envi-ronments. We illustrate the approach in a virtual laboratory domain involving laboratory instruments, containers, tools, and material-transfer actions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。