让AI先写出数学问题的公式,再求解,效果显著提升。
Formula-One Prompting: A Composable Equation-First Prefix for Applied Mathematics
- 先让模型写出问题的控制方程,再求解,提升推理效率。
- 在多个数学任务上比传统方法平均高出8.42个百分点,最高达13.30点。
- 仅需68个提示词开销,适合追求高效精准的数学应用。
本文提出公式提示(FP)与公式一提示(F-1),两种单次调用方法,在求解应用数学问题前先提取其控制方程。基于对81.7万亿预训练标记的分析发现,方程型语言在数据集DataComp-LM中出现频率是代码的121倍、步骤叙述的3.79倍,但常规提示方法未充分激发此模式。FP要求模型先形式化问题的方程;F-1进一步引入可组合的第二阶段,同一调用中选择直接求解、思维链或代码式求解策略。在五种推理模型和四个应用数学基准(金融、物理、密码学、竞赛数学)上,F-1平均优于CoT 5.76个百分点、优于PoT 8.42个百分点,金融数学任务最高提升13.30个百分点;仅需68个提示词开销,便突破准确率-令牌效率边界。消融实验表明,方程形式化前缀是主要驱动力:在已有前缀基础上叠加CoT或PoT无额外增益,73.3%的失败发生在正确方程后的求解阶段。
原文摘要 · Abstract (English)
This paper introduces Formula Prompting (FP) and Formula-One Prompting (F-1), two single-call methods that elicit governing equations before solving applied-math problems. Chain-of-Thought (CoT) and Program-of-Thought (PoT) prompting improve mathematical reasoning by eliciting reasoning traces or code-like structures learned during pretraining. This suggests a diagnostic question: which useful pretraining patterns remain under-elicited? Using infini-gram-mini, we scan 81.7 trillion pretraining tokens and find that, in curated corpora such as DataComp-LM, equation-centered language appears 121x more often than code and 3.79x more often than step-by-step narration, yet standard prompting methods do not explicitly elicit equation formulation. FP asks the model to formalize a problem's governing equations before solving; F-1 extends FP with a composable Phase 2 that selects Direct, CoT, or PoT-style solving in the same call. Across five reasoning models and four applied-math benchmarks (finance, physics, cryptography, competition math), F-1 outperforms CoT by 5.76 pp and PoT by 8.42 pp on average, with the largest gain of 13.30 pp on FinanceMath, while topping the accuracy-token efficiency frontier at only 68 prompt tokens of overhead. Variant ablations identify the equation-formalization prefix, not the strategy menu, as the primary driver: adding CoT or PoT on top of the prefix yields no further gain, and 73.3% of remaining failures occur downstream of a correct Phase-1 equation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。