用智能分解法提前发现微调数据缺失能力,避免无效训练。
Diagnosing Capability Gaps in Fine-Tuning Data
- 将目标拆解为可评估的子目标,逐个分析数据覆盖度。
- 实验显示能准确识别25.6%的能力下降,非目标项仅降2.1%。
- 适合需要高效优化微调数据的研究者和工程师使用。
为特定领域任务微调大语言模型需数据集全面覆盖目标能力,但如何在昂贵微调前识别数据缺失能力仍无解。本文提出GoalCover框架,通过交互式目标分解与自动化覆盖率评估,系统检测数据集能力缺口。该框架将高层目标分解为原子级、可独立评估的子目标;基于大模型计算每个样本对各子目标的对齐得分;并通过低分样本解释自动揭示缺失能力。在医疗问答、法律摘要、代码生成三个领域进行受控破坏实验,结果表明目标子目标平均下降25.6%,非目标项仅下降2.1%(Cohen's d=1.24),验证了其有效性。在金融摘要强化微调任务中,使用GoalCover筛选的数据使模型评分从3.77提升至4.12(满分5),结合目标条件合成样本更达4.20。结果表明GoalCover可作为实用的预微调诊断工具,有效识别并提供填补能力缺口的信号。
原文摘要 · Abstract (English)
Fine-tuning large language models (LLMs) for domain-specific tasks requires training datasets that comprehensively cover the target capabilities a practitioner needs. Yet identifying which capabilities a dataset fails to support, and doing so before an expensive fine-tuning run, remains a largely unsolved problem. We introduce GoalCover, a framework that helps practitioners systematically detect capability gaps in fine-tuning datasets through interactive goal decomposition and automated coverage assessment. GoalCover guides a practitioner through structured decomposition of a high-level goal into atomic, independently evaluable subgoals; assigns each training sample an LLM-based alignment score against every subgoal; and surfaces missing capabilities through automated analysis of low-scoring sample explanations. We validate the framework along two complementary axes. First, through controlled corruption experiments across three domains (medical QA, legal summarization, code generation), we show that GoalCover reliably distinguishes targeted from non-targeted capability impacts: target subgoals degrade by 25.6% on average versus 2.1% for non-target subgoals (Cohen's d=1.24). Second, we demonstrate downstream utility on a financial-summarization Reinforcement Fine-Tuning (RFT) task with Qwen-3-14B: training on GoalCover-filtered data improves the LLM-judge reward from 3.77 to 4.12 (out of 5) over the unfiltered baseline, and combining filtered data with goal-conditioned synthetic samples yields the strongest result (4.20). The two results together show that GoalCover works as a practical pre-fine-tuning diagnostic: it detects capability gaps and produces concrete signal for closing them.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。