arXiv:2605.27709cs.CL2026-05

通过答案反演生成可验证的数学题,检测模型是否真会解题。

ReverseMath: Answer Inversion for Scalable and Verifiable Mathematical Problem Generation

论文配图:ReverseMath: Answer Inversion for Scalable and Verifiable Mathematical Problem Generation
图 1 · 摘自论文原文
  • 用答案反推构造新题目,确保答案正确性
  • 模型在反转题上常出错,暴露记忆而非推理能力
  • 可用于训练增强,提升多基准数学能力

数学推理评测对评估大语言模型至关重要,但许多评测数据静态且反复使用,导致难以区分模型是真正推理还是单纯记忆。手动构建新题且答案可靠成本高昂。我们提出 ReverseMath,一种通过答案反演实现可扩展数学题生成的方法:给定原题与答案,将原题中的数值掩蔽,以原答案为已知条件重构问题,使被掩蔽值变为新答案。生成题反转了输入输出关系,答案由构造保证正确。研究显示,在评估中,原题与反转题对比揭示模型行为显著变化——模型有时在反转题上失败,甚至错误输出原答案,表明存在记忆现象。在训练中,ReverseMath 自动生成带标签的反转题,用于强化学习的数据增强。实验表明,加入此类数据能有效提升多个基准上的数学推理性能,证明其既是分析工具,也是可扩展的可信训练数据源。

原文摘要 · Abstract (English)

Mathematical reasoning benchmarks are vital for evaluating large language models (LLMs), but many are static and repeatedly exposed through public evaluation and training pipelines, making it difficult to separate genuine reasoning from memorization. Meanwhile, manually constructing new math problems with reliable answers remains costly. We introduce ReverseMath, a scalable method for generating new math problems through answer inversion. Given a problem and its answer, ReverseMath masks a numerical value in the original problem, treats the original answer as a known condition, and rewrites the problem so that the masked value becomes the new answer. The generated problem reverses the original input-output relation, making its answer known by construction. We study ReverseMath for both evaluation and training. For evaluation, paired original/reversed problems reveal substantial behavioral shifts: models sometimes fail on reversed problems and even incorrectly output the original answer, suggesting memorization-like behavior. For training, ReverseMath provides automatically labeled reversed problems as data augmentation for reinforcement learning (RL). Experiments show that including ReverseMath-generated data improves mathematical reasoning performance across multiple benchmarks, demonstrating its value as both an analysis tool and a scalable source of verifiable training data.

数学推理数据生成模型评估强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。