arXiv:2512.02812cs.AI2025-12被引 1

无需人工提示,自动验证并改进论文转代码的流程。

Enhancing Automated Paper Reproduction via Prompt-Free Collaborative Agents

  • 用两个协作智能体自动检查和修正每步生成结果。
  • 在两个数据集上准确率提升约15%,完整率提升13%。
  • 适合需要自动化科研复现的开发者和研究者。

自动化论文复现已成为加速科学研究的有前景方法,通过多步骤工作流将学术论文转化为可执行代码。然而,现有框架常缺乏对每一步输出的验证与优化机制,或严重依赖人工设计的提示进行自修正,限制了其适应性和可扩展性。为此,我们提出一种无需提示的协作智能体框架,自动提升论文到代码生成的质量。该方法包含两个协作智能体:验证智能体检查每步输出是否符合对应系统提示的要求,修正智能体则基于识别出的问题进行修改。与以往需专家手工编写特定修正提示的方法不同,本框架仅利用原始系统提示即可实现自动验证与优化。我们将协作智能体集成至Paper2Code框架,在PaperBench Code-Dev与Paper2CodeBench数据集上开展全面实验。结果表明,相比无智能体的基线模型,本方法在准确率和完整性上分别提升约15%和13%。此外,与Self-Refine对比实验验证了该方法在不同数据集上的鲁棒性与一致性。

原文摘要 · Abstract (English)

Automated paper reproduction has emerged as a promising approach to accelerate scientific research, employing multi-step workflow frameworks to systematically convert academic papers into executable code. However, existing frameworks often lack mechanisms to verify and refine the outputs at each generation step, or rely heavily on manually designed prompts for self-refinement, which limits their adaptability and scalability. To address these limitations, we propose a prompt-free collaborative agent framework that automatically enhances the quality of paper-to-code generation. Our approach employs two collaborative agents: a verification agent that examines whether the outputs at each step satisfy the requirements specified in the corresponding system prompt, and a refinement agent that revises the outputs based on the identified issues. Unlike previous methods that require human experts to craft specific refinement prompts for each step, our framework achieves automatic verification and improvement by leveraging only the original system prompts. We integrate our collaborative agents into the Paper2Code framework and conduct comprehensive experiments on PaperBench Code-Dev and Paper2CodeBench datasets. Experimental results demonstrate that our approach significantly improves the accuracy and completeness of reproduced code, achieving performance gains of approximately 15\% and 13\%, respectively, compared to the baseline without our agents. Furthermore, comparative experiments against Self-Refine validate the robustness and consistency of our prompt-free approach across different datasets.

自动化复现代码生成智能体协作

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。