用专家制定的评分标准,让大模型在专业领域更靠谱。
APTER: Adaptive Post-Training with Expert-Grounded Rubrics

- 基于专家标准生成可复用的细粒度评分规则,无需参考答案。
- 数学与医学任务中,模型得分最高提升15.86和8.04点。
- 适合需要精准推理的专业场景,如医疗、科研等。
随着大语言模型进入专业领域,需满足领域约束、包含关键证据并提供完整推理,而非仅生成流畅回答。现有后训练方法多依赖整体偏好或结果验证,而近期基于评分标准的方法通常为每条查询独立生成标准,导致关键要求遗漏且标准不一致,难以诊断和修复持续性能力缺陷。本文提出APTER(自适应后训练框架),将结构化领域知识融入细粒度评估、优化与诊断,以支持复杂专业推理。首先,专家构建稳定的领域能力标准框架;对每个查询,从中选取相关标准并实例化为关联源标准的查询级评分标准,实现无需参考答案的可执行监督。其次,利用评分结论同时驱动优化与准则级诊断;通过聚合各准则下的低分判断,识别持续性缺陷,并在强化学习中触发针对性微调。在数学推理与医学问答任务上的实验表明,三轮模型迭代中,APTER使数学与医学平均得分分别相较基线模型最高提升15.86和8.04点。代码与评分数据集已公开于https://github.com/AntDT-APTER/APTER。
原文摘要 · Abstract (English)
As large language models enter professional domains, they must satisfy domain constraints, include critical evidence, and provide complete reasoning rather than merely produce fluent responses. Existing post-training methods often rely on holistic preferences or outcome-level verification, while recent rubric-based methods usually generate rubrics independently for each query. In specialized domains, such unconstrained rubrics may omit critical requirements and vary across samples, hindering the diagnosis and targeted repair of persistent capability deficiencies. We propose APTER (Adaptive Post-Training with Expert-Grounded Rubrics), a framework that integrates structured domain knowledge into fine-grained evaluation, optimization, and diagnosis for specialized complex reasoning. First, expert-grounded rubric construction starts from an expert criteria framework built by domain experts, where each criterion represents a stable professional capability. For each query, APTER selects relevant criteria and instantiates them into query-level rubrics linked to their source criteria, turning reusable expert criteria into executable query-level supervision without reference answers. Second, adaptive post-training uses rubric verdicts as both optimization and criterion-level diagnostic signals. Aggregating low-scoring verdicts by criterion ID reveals persistent deficiencies and triggers targeted supervised fine-tuning updates during reinforcement learning. Experiments on mathematical reasoning and medical question answering show consistent gains across both domains. Across three model generations, APTER improves the mathematics and medical averages over the corresponding base models by up to 15.86 and 8.04 points, respectively. Code and rubric datasets are available at https://github.com/AntDT-APTER/APTER.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。