让大模型自动化科研流程更可靠,确保每一步可复现、可审计。
R-LAM: Reproducibility-Constrained Large Action Models for Scientific Workflow Automation
- 通过结构化动作模板与确定性执行策略控制行为
- 实验成功率提升,错误可追踪且流程可重演
- 适合需要严格复现性的科研自动化场景
大型动作模型(LAMs)通过自主决策和工具执行扩展了大语言模型,有望实现科研流程自动化。然而,科研流程对可复现性、可审计性和确定性执行有严格要求,通用基于LLM的智能体难以满足。不受约束的动作生成可能导致隐式状态变更、非确定性执行和不可复现的结果,限制了LAM在科研中的应用。本文提出R-LAM,一种面向科研流程自动化的可复现性约束框架。R-LAM引入结构化动作模式、确定性执行策略和显式溯源追踪,确保每个动作和中间产物均可审计和重放。框架支持故障感知的执行循环与受控的工作流分叉,实现迭代实验而不损害可复现性。我们实现了轻量级Python框架并开源为PyPI包。对代表性科研工作流的评估表明,相比无约束的LLM智能体,R-LAM显著提升了可复现成功率和执行可靠性,同时保持对流程执行的自适应控制。
原文摘要 · Abstract (English)
Large Action Models (LAMs) extend large language models by enabling autonomous decision-making and tool execution, making them promising for automating scientific workflows. However, scientific workflows impose strict requirements on reproducibility, auditability, and deterministic execution, which are not satisfied by generic LLM-based agents. Unconstrained action generation can lead to silent state changes, non-deterministic executions, and irreproducible experimental results, limiting the applicability of LAMs in scientific settings. In this paper, we propose R-LAM, a reproducibility-constrained framework for applying Large Action Models to scientific workflow automation. R-LAM introduces structured action schemas, deterministic execution policies, and explicit provenance tracking to ensure that every action and intermediate artifact is auditable and replayable. The framework supports failure-aware execution loops and controlled workflow forking, enabling iterative experimentation without compromising reproducibility. We implement R-LAM as a lightweight Python framework and release it as an open-source PyPI package to facilitate reproducible research. An experimental evaluation of representative scientific workflows demonstrates that R-LAM improves reproducibility success rates and execution reliability compared to unconstrained LLM-based agents, while retaining adaptive control over workflow execution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。