arXiv:2607.10508cs.DBcs.AI2026-07

用数据库思想让AI科研更可靠、不浪费、可追溯。

Confining Nondeterminism: AI-Driven Research Systems as DBMSs for Reliable, Non-Wasteful, Transparent, and Collaborative Research [Vision]

  • 把科研流程变成确定性数据流,LLM只负责写代码,不直接执行。
  • 所有结果必须有执行记录,杜绝无依据的报告和重复计算。
  • 适合需要复现、协作或追求可信度的科研团队使用。

当前基于大模型的科研代理(LLM agents)虽能从问题到图表自主完成研究,但不可信:同一问题两次回答不同,报告数字无执行支撑,上游变更导致下游结果静默过期,且重复运行预处理和重写已生成代码。根本原因在于每个环节都是不可见状态的随机调用。我们借鉴数据库设计,提出将研究项目构建为确定性、版本化数据流引擎(类似带物化视图的查询计划),让LLM与用户共同充当仅可修改该计划的随机编译器,执行器永不调用LLM。LLM输出仅以版本化代码和数据形式进入,任何宣称结果必须附带执行记录。五项设计规则使版本控制、溯源、增量维护与成本调度等数据库机制成为研究可靠、非浪费、透明、可协作的保障。本文提出诊断、需求与设计;完整原型与研究议程将在后续版本中详述。我们主张:LLM应为查询编译器,而非执行器。

原文摘要 · Abstract (English)

LLM agents that conduct research (proposing ideas, writing and running code, analyzing results) can already carry a study from research question to figures, yet cannot be fully trusted. The same question asked twice in a row returns different answers; the agent announces a number that no execution produced, and tool use does not prevent this, because nothing binds what the agent reports to what its tools returned; a small upstream change leaves downstream results silently stale, with no way to list which ones; and the agent re-runs preprocessing and rewrites code it has already produced. We argue these failures share one root: every step of today's agent loop is a stochastic LLM call whose internal state nobody, including the agent, can check. Rather than trying to see inside the LLM, we take a lesson from databases, which earn trust without being watched, because deterministic operators over well-defined state make their guarantees hold by construction. We propose organizing a research project the same way. The project lives in a deterministic, versioned dataflow engine (in effect, a query plan over materialized views), and the LLM, together with the user, is a stochastic compiler that may only edit that plan. The executor never calls the LLM; LLM output enters only as versioned code and data that the executor then runs, and any asserted result enters the record only with an execution behind it. Five design rules at this boundary turn familiar database machinery, from versioning and provenance to incremental maintenance and cost-based scheduling, into guarantees that make research reliable, non-wasteful, transparent, and collaborative. This report presents the diagnosis, the requirements, and the design; the guarantee walkthrough, a prototype, and the research agenda appear in the full version, in preparation. The LLM, we argue, should be the query compiler, never the executor.

AI科研数据库可信生成自动化研究

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。