DeepCode让代码代理自动把论文转成可运行代码,质量超过人类专家。
DeepCode: Open Agentic Coding
- 通过信息流管理四步操作,解决大模型上下文瓶颈问题。
- 在PaperBench上超越Cursor、Claude Code等商用工具,媲美博士级人类专家。
- 适合科研自动化、代码生成与学术复现场景,推动科研效率提升。
大型语言模型的进步催生了强大的编码代理,使代码助手有望演变为代码工程师。然而,现有方法在实现高保真从文档到代码库的合成(如将科学论文转化为代码)时仍面临严峻挑战,主要源于信息过载与大模型上下文瓶颈之间的根本矛盾。本文提出DeepCode,一个完全自主的框架,通过原则性信息流管理从根本上解决该问题。将仓库合成视为信道优化问题,DeepCode无缝协调四种信息操作,在有限上下文预算下最大化任务相关信号:基于蓝图提炼的源码压缩、使用状态化代码记忆的结构化索引、通过检索增强生成的条件知识注入,以及闭环错误纠正。在PaperBench基准上的大量评估表明,DeepCode达到当前最佳性能,显著优于Cursor和Claude Code等领先商业代理,并关键性地在核心复现指标上超越顶尖机构的博士级人类专家。通过系统性地将论文规格转化为接近人类专家水平的生产级实现,本工作为自主科学复现建立了新基础,有望加速研究评估与发现。
原文摘要 · Abstract (English)
Recent advances in large language models (LLMs) have given rise to powerful coding agents, making it possible for code assistants to evolve into code engineers. However, existing methods still face significant challenges in achieving high-fidelity document-to-codebase synthesis--such as scientific papers to code--primarily due to a fundamental conflict between information overload and the context bottlenecks of LLMs. In this work, we introduce DeepCode, a fully autonomous framework that fundamentally addresses this challenge through principled information-flow management. By treating repository synthesis as a channel optimization problem, DeepCode seamlessly orchestrates four information operations to maximize task-relevant signals under finite context budgets: source compression via blueprint distillation, structured indexing using stateful code memory, conditional knowledge injection via retrieval-augmented generation, and closed-loop error correction. Extensive evaluations on the PaperBench benchmark demonstrate that DeepCode achieves state-of-the-art performance, decisively outperforming leading commercial agents such as Cursor and Claude Code, and crucially, surpassing PhD-level human experts from top institutes on key reproduction metrics. By systematically transforming paper specifications into production-grade implementations comparable to human expert quality, this work establishes new foundations for autonomous scientific reproduction that can accelerate research evaluation and discovery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。