arXiv:2512.01224cs.LG2025-12被引 4

用外部工具精准验证科学计算答案,提升大模型推理可靠性。

CoSineVerifier: Tool-Augmented Answer Verification for Computation-Oriented Scientific Questions

  • 结合外部计算引擎进行符号化求解与数值运算
  • 在VerifyBench-Hard和SCI-Bench上达最新水平
  • 适合需要高精度科学推理的场景

答案验证方法广泛应用于语言模型训练中的数据筛选、评估及基于可验证奖励的强化学习(RLVR)。现有工作多聚焦于跨场景通用验证器,但在代数等价性判断与物理常数代入等计算型科学任务中仍面临挑战。本文提出 model,一种借助外部执行器实现精确计算与符号简化的能力增强型验证器。该模型采用两阶段流程:先冷启动微调,再融合工具的多轮强化学习。在科学、通用问答及长文本推理任务上的实验表明其具有强泛化能力。结果显示, model 在 VerifyBench-Hard 与 SCI-Bench 上达到当前最优性能;将其用于 RLVR 作为奖励模型时,在 AIME'24 与 AIME'25 上持续优于基于规则与模型的验证器,显著提升大模型的推理能力。模型已开源于 https://huggingface.co/Nanbeige/CoSineVerifier-Tool-4B。

原文摘要 · Abstract (English)

Answer verification methods are widely employed in language model training pipelines spanning data curation, evaluation, and reinforcement learning with verifiable rewards (RLVR). While prior work focus on developing unified verifiers applicable across multiple reasoning scenarios, significant challenges remain in computation-oriented scientific domains, such as algebraic equivalence checking and physical constant substitution. In this paper, we introduce \model, a tool-augmented verifier that leverages external executors to perform precise computations and symbolic simplifications. \model enables robust verification that goes beyond simple semantic matching. We propose a novel two-stage pipeline, which begin with cold-start fine-tuning and followed by multi-turn reinforcement learning with tool integration. Extensive experiments conducted on STEM subjects, general QA, and long-form reasoning tasks demonstrates strong generalization of \model. The results shows that the \model achieves state-of-the-art performance on VerifyBench-Hard and SCI-Bench. And we also employ our \model in RLVR as a reward model, the results show that it consistently outperforms both rubric-based and model-based verifiers on AIME'24 and AIME'25, demonstrating strong potential to enhance reasoning capabilities of LLM. Our model is released at \hyperlink{https://huggingface.co/Nanbeige/CoSineVerifier-Tool-4B}{https://huggingface.co/Nanbeige/CoSineVerifier-Tool-4B}.

答案验证科学推理强化学习工具增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。