arXiv:2608.18312cs.CLcs.CY2026-08

为自主科研智能体设计可审计的证据-声明关联追踪系统

Artifact-centered Claim-aware Observability for Autonomous Scientific Agents

论文配图:Artifact-centered Claim-aware Observability for Autonomous Scientific Agents
图 1 · 摘自论文原文
  • 以声明和产物为核心构建可观测性框架,明确其关联关系
  • 支持跨对象故障定位,如错误引用、隐含规则依赖等
  • 适合科研自动化系统开发者与可信实验审计人员

自主科研智能体已能提出假设、编写代码、运行实验、分析结果甚至撰写论文。然而,仅记录模型调用不足以实现有效审计,科学家还需审查系统生成的产物与声明及其相互关系。因为科研智能体的失败常分散于多个对象之间:文稿声明可能引用错误证据,搜索过程可能选中无效候选,实验室新奇性声明可能依赖未明说规则,多智能体计划可能在无可见触发下变更。现有追踪、实验管理及归档溯源工具虽有价值,但其原生对象未将科学审计关系作为核心。我们主张,自主科研系统应输出可移植的、声明感知的产物血缘作为最低审计层。为此提出一种围绕个体、操作者、适应度记录、血缘、归档、运行、流和引导命令组织的紧凑可观测性概要。在此框架中,科学声明作为普通个体,具有显式证据绑定和验证记录。该概要旨在作为语义层,补充当前遥测与溯源标准。执行细节仍保留在 OpenTelemetry,最终包可导出至 PROV-O 或 RO-Crate 标准。

原文摘要 · Abstract (English)

Autonomous scientific agents now increasingly propose ideas, write code, run experiments, analyze results, and even draft papers. Observe and audit those agents are necessary but logging every model call is not enough, scientists also need to inspect the artifacts and claims that the systems produced and their relations. This is driven by the fact that failures in scientific agent systems are often distributed across several objects. A manuscript claim may cite the wrong evidence, a search process may select a degenerate candidate, a laboratory novelty claim may depend on an unstated rule, or a multi-agent plan may change without a visible trigger. Existing tracing, experiment tracking, and archival provenance tools are valuable, but their native objects do not make these scientific audit relations first-class. We argue that autonomous scientific systems should emit portable, claim-aware artifact lineage as a minimum audit layer. We propose a compact observability profile organized around individuals, operators, fitness records, lineage, archives, runs, streams, and steering commands. In this profile, scientific claims are ordinary individuals with explicit evidence bindings and verification records. The profile is intended as a semantic layer that complements current telemetry and provenance standards. Execution details can remain in OpenTelemetry. Final packages can export to PROV-O or RO-Crate standards.

科研自动化可解释性证据追踪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。