用可执行的研究包替代传统论文,让AI能复现和扩展科研成果。
The Last Human-Written Paper: Agent-Native Research Artifacts

- 构建四层可执行研究包,保留失败实验与完整实现细节。
- 在PaperBench上问答准确率从72.4%提升至93.7%,复现成功率从57.4%升至64.4%。
- 适合希望提升可复现性与支持AI科研的团队或平台使用。
科学论文将复杂的迭代研究过程压缩为线性叙事,丢弃了大量探索路径与失败实验,造成两种结构性损耗:故事税(舍弃失败尝试以迎合线性叙述)与工程税(忽略实现细节导致无法被代理理解)。这对人类尚可容忍,但对需复现与拓展工作的AI代理而言却成为障碍。本文提出代理原生研究资产(ARA),一种以四层结构组织的机器可执行研究包:科学逻辑、完整可执行代码、保留失败路径的探索图谱,以及每项主张对应的原始输出证据。配套三机制支撑:实时研究管理器记录开发中的决策与死胡同;ARA编译器将旧文献与代码库转化为ARA;ARA原生评审系统自动化客观检查,使人类审稿人聚焦于意义、创新与品味。在PaperBench与RE-Bench测试中,ARA将问答准确率从72.4%提升至93.7%,复现成功率从57.4%增至64.4%。在RE-Bench五个开放式拓展任务中,保存的失败轨迹既加速进展,也可能因限制代理跳出既有框架而产生约束效应,取决于代理能力。代码已开源:https://github.com/Orchestra-Research/Agent-Native-Research-Artifact。
原文摘要 · Abstract (English)
Scientific publication compresses a branching, iterative research process into a linear narrative, discarding the majority of what was discovered along the way. This compilation imposes two structural costs: a Storytelling Tax, where failed experiments, rejected hypotheses, and the branching exploration process are discarded to fit a linear narrative; and an Engineering Tax, where the gap between reviewer-sufficient prose and agent-sufficient specification leaves critical implementation details unwritten. Tolerable for human readers, these costs become critical when AI agents must understand, reproduce, and extend published work. We introduce the Agent-Native Research Artifact (ARA), a protocol that replaces the narrative paper with a machine-executable research package structured around four layers: scientific logic, executable code with full specifications, an exploration graph that preserves the failures compilation discards, and evidence grounding every claim in raw outputs. Three mechanisms support the ecosystem: a Live Research Manager that captures decisions and dead ends during ordinary development; an ARA Compiler that translates legacy PDFs and repos into ARAs; and an ARA-native review system that automates objective checks so human reviewers can focus on significance, novelty, and taste. On PaperBench and RE-Bench, ARA raises question-answering accuracy from 72.4% to 93.7% and reproduction success from 57.4% to 64.4%. On RE-Bench's five open-ended extension tasks, preserved failure traces in ARA accelerate progress, but can also constrain a capable agent from stepping outside the prior-run box depending on the agent's capabilities. Our code is open-sourced at https://github.com/Orchestra-Research/Agent-Native-Research-Artifact.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。