用自动数据生成提升数学定理形式化,让AI更懂数学语言。
ATLAS: Autoformalizing Theorems through Lifting, Augmentation, and Synthesis of Data
- 基于概念库和知识蒸馏,自动生成高质量数学定理的非形式到形式化对齐数据。
- 构建11.7万条本科级定理数据集,新模型在所有基准上显著优于现有方法。
- 适合数学自动化、形式化验证及大模型训练的研究者使用。
自动形式化指将自然语言数学内容自动翻译为机器可验证的形式语言,近年来受益于大语言模型的发展取得显著进展。然而,其进一步提升的主要障碍在于缺乏非形式化数学文本与对应形式化版本的并行语料库。为此,本文提出ATLAS(通过提升、增强与数据合成实现定理自动形式化)框架,用于生成大规模、高质量的定理陈述并行语料库。不同于以往方法,ATLAS从概念库出发,结合专家迭代与知识蒸馏加速学生模型优化,并引入两种利用形式语言结构特性的新型增强策略。经过10轮迭代,我们构建了一个包含11.7万条定理的本科水平数据集,并基于Llama3.1-8B-Instruct与LoRA微调得到ATLAS Translator。该模型在所有基准测试中均显著优于Herald Translator与Kimina-Autoformalizer(p<0.05,双侧t检验)。此外,我们还证明在更强基模型上全参数微调ATLAS数据集可获得更优性能。数据集、模型与代码已开源。
原文摘要 · Abstract (English)
Autoformalization, the automatic translation of mathematical content from natural language into machine-verifiable formal languages, has seen significant progress driven by advances in large language models (LLMs). Nonetheless, a primary barrier to further improvements is the limited availability of parallel corpora that map informal mathematical text to its formal counterpart. To address this limitation, we propose ATLAS (Autoformalizing Theorems through Lifting, Augmentation, and Synthesis of Data), a novel data generation framework designed to produce large-scale, high-quality parallel corpora of theorem statements. Distinct from prior approaches, ATLAS begins with a concept repository, accelerates the improvement of the student model through expert iteration combined with knowledge distillation, and introduces two novel augmentation strategies that exploit the structural characteristics of formal languages. Running the proposed ATLAS framework for 10 iterations, we construct an undergraduate-level dataset of 117k theorem statements and develop the ATLAS Translator by fine-tuning Llama3.1-8B-Instruct with LoRA. This model establishes a new state of the art, demonstrating statistically significant improvements over both the Herald Translator and the Kimina-Autoformalizer across all benchmarks (p<0.05, two-sided t-test). Furthermore, we demonstrate that the full-parameter fine-tuning of a stronger base model on the ATLAS dataset leads to superior performance. The datasets, model, and code are available at https://github.com/XiaoyangLiu-sjtu/ATLAS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。