ProofCouncil用智能体协作解决数学难题，6题获评委认可
ProofCouncil: An LLM Agent for Solving Open Mathematical Problems
- 采用作者-批评家架构，模拟数学家合作解题
- 在10个真实数学题中6题通过评审，30题中有5题完全正确
- 开源工具链助力社区复现，适合数学智能体研究者
大型语言模型在解决开放数学问题方面展现出日益增长的潜力。然而，通过针对现实数学实践设计的智能体工作流，其性能可进一步提升。为此，我们提出ProofCouncil，一种基于作者-批评家架构的数学智能体，用于自主解决开放问题。ProofCouncil作为参赛作品提交至第二届FirstProof挑战赛，该赛事包含10个真实世界数学问题，要求智能体自主求解。在10个问题中，其6个提交成果被评委判定为仅需微小修改即正确，表现优于所有参赛团队。此外，我们在数学研究者提供的30个开放问题上评估ProofCouncil，其中21个获得人工反馈：5个被判定为完全正确，2个被认为有希望待最终验证，另有8个取得有意义的部分进展。本文简要描述ProofCouncil的开发过程及其背后智能体构建库的设计，该库已开源以供社区使用。
原文摘要 · Abstract (English)
Large language models (LLMs) have shown increasing promise in solving open problems in mathematics. However, their performance can be further improved through agentic workflows tailored to real-world mathematical practice. To this end, we introduce ProofCouncil, a mathematical agent that is designed to tackle open problems using an author-critic architecture. ProofCouncil served as a submission to the second batch of FirstProof, a challenge consisting of 10 real-world mathematical problems that agents must solve autonomously. Its submissions for 6 of the 10 problems were judged by the referees to be correct up to at most minor revisions, showing the best performance among participating teams. We also evaluate ProofCouncil on 30 open problems collected from mathematical researchers. Among the 21 solutions that received human feedback, 5 were judged completely correct, 2 more were judged promising pending final verification, and a further 8 contained useful partial progress. In this short paper, we describe the development of ProofCouncil and the agent-building library used to create it, which we release as open source to the community.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。