arXiv:2606.04273cs.AI2026-06

研究人类如何在数学证明形式化中使用AI,发现人机协作能提升准确率。

Human agency in initial human-AI proof formalization workflows

论文配图:Human agency in initial human-AI proof formalization workflows
图 1 · 摘自论文原文
  • 通过混合方法分析人类使用AI进行数学证明形式化的方式与动机。
  • 有AI辅助时,形式化准确率高于独立完成,且多数人灵活切换多种AI工具。
  • 强调保持人类对证明过程的控制权,适合关注人机协同的科研人员。

几个世纪以来,人类数学家一直撰写证明以支持其数学论证;然而,自动验证证明有效性长期是个挑战。人工智能系统在生成代码和进行高层次数学推理方面的能力进步,有望彻底改变人们形式化并验证证明的能力。尽管许多研究聚焦于当前前沿的基准测试,本文则关注人类如何使用这些工具,并在其中发挥主体性。我们采用混合方法分析了AI对形式化工作流的初步影响:人们声称的需求、实现愿景的障碍,以及实践中如何使用和适应AI。定性调查发现,尽管偏好多样,但普遍希望在形式化过程中获得AI协助,同时保持高水平的人类控制与主体性。为评估实际互动情况,我们在不同难度和领域的问题上开展受控用户研究,参与者在有无AI辅助的情况下形式化非正式数学问题及其证明。尽管当时自动形式化工具仍有局限,但使用AI的参与者整体形式化准确率更高,且多数人灵活选用多种不同AI工具。我们的工作揭示了AI融入形式化流程初期阶段的复杂互动,体现了人类主体性与AI参与之间的紧密交织。

原文摘要 · Abstract (English)

For centuries, human mathematicians have written proofs to substantiate their mathematical arguments; yet, the ability to automatically verify the validity of proofs has long been a challenge. Advances in AI systems' ability to generate code and engage in increasingly high-level mathematical reasoning promise to transform people's ability to formalize and thereby verify proofs. While many works focus on benchmarking the current frontier, we instead study how people use these tools and apply agency in doing so. We conduct a mixed-methods analysis into the initial impact of AI on people's formalization workflows: what people claim they want, what they see as the barriers to those visions, and how they actually use and adapt AI in practice. A qualitative survey reveals that people's preferences are diverse, but with a general desire for AI assistance in formalization that preserves high-level human control and agency over the proof discovery process. To assess how people actually engage with AI for formalization, we conduct a controlled user study in which participants formalize informal math problems and their proofs, with and without AI, across a range of mathematical problems at varying levels of difficulty and domains. Despite limitations of the tools at the time for autoformalization, participants tended to attain higher formalization accuracy when allowed access to AI tools than when formalizing on their own, with most participants flexibly choosing to use multiple different AI tools. Taken together, our work sheds light on the early stages of AI integration into formalization workflows, involving an intimate interplay of human agency and AI engagement.

人机协作形式化证明AI辅助

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。