arXiv:2609.05221cs.CLcs.AI2026-09

用验证器引导增强推理可解释性,提升教育问答透明度。

A Verifier-Guided Explainable Reasoning Framework with Gold-Anchored QLoRA, Task-Aware Mixture-of-Experts, and Group-Relative RLVR

论文配图:A Verifier-Guided Explainable Reasoning Framework with Gold-Anchored QLoRA, Task-Aware Mixture-of-Experts, and Group-Relative RLVR
图 1 · 摘自论文原文
  • 用权威答案锚定的QLoRA微调模型,确保推理起点可靠。
  • 根据任务类型分配符号验证器,推理深度评分提升至72.20%。
  • 适合需要高可信度解释的教育类问答系统开发者。

大型语言模型虽具强推理能力,但其解释常不一致、缺乏依据或难验证。本文提出一种验证器引导的可解释推理框架,融合金标准锚定的QLoRA、任务感知的符号路由与组相对强化学习验证(RLVR)。先以领域加权的QLoRA对Qwen2.5-3B-Instruct进行微调,锚定于权威答案;轻量级路由器将逻辑题导向一阶逻辑/Z3验证器,物理题导向带公式与单位感知的符号求解器。验证反馈用于候选生成评估、自我修正及奖励构建。候选响应从三维度评价:P1(答案正确性)、P2(证据或单位一致性)、P3(推理深度与可解释性)。推理时采用无金标准自一致性聚合多候选,并由仅问题的物理验证器进行保守系统级修正。在438个保留样本上,RLVR使P3从50.68%提升至72.20%,混合P1稳定在55.94%;自一致性将模型仅P1从48.86%提升至50.23%,符号验证贡献剩余增益。结果表明,RLVR主要强化显式推理结构,而符号验证则通过系统级校验提升答案可靠性。

原文摘要 · Abstract (English)

Large language models (LLMs) show strong reasoning ability, but their explanations can remain inconsistent, weakly grounded, or difficult to verify. We propose a verifier-guided explainable reasoning framework for transparent educational question answering that combines gold-anchored QLoRA, task-aware symbolic routing, and group-relative RLVR. Qwen2.5-3B-Instruct is first adapted with field-weighted QLoRA supervision anchored to authoritative answers. A lightweight router then assigns logic problems to a FOL/Z3 verifier and physics problems to a formula- and unit aware symbolic solver. Verifier feedback is further used to support candidate evaluation, self-revision, and reward construction during RLVR. Candidate responses are evaluated along three complementary dimensions: P1 for answer correctness, P2 for evidence or unit consistency, and P3 for reasoning depth and explainability. At inference, gold-free self-consistency aggregates multiple candidate responses before an optional question-only physics verifier performs conservative system-level correction. On 438 held-out examples, RLVR increases P3 from 50.68% to 72.20%, while hybrid P1 remains approximately stable at 55.94%. Self-consistency improves model only P1 from 48.86% to 50.23%, with symbolic verification providing the remaining hybrid gain. These results indicate that RLVR primarily strengthens explicit reasoning structure, while symbolic verification complements the neural policy by improving answer reliability at the system level.

可解释推理验证器引导教育问答RLVR

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。