arXiv:2604.08388cs.AI2026-04

微调会抑制模型工具使用能力,少量领域数据即可唤醒其通用工具调用潜力。

Awakening the Sleeping Agent: Lean-Specific Agentic Data Reactivates General Tool Use in Goedel Prover

  • 用100条Lean领域指令数据微调,恢复模型工具调用能力。
  • 工具调用准确率从接近0%提升至83.8%,接近原始模型水平。
  • 适合关注大模型泛化能力与微调副作用的研究者。

在形式数学领域对模型进行大量监督微调会严重抑制其原有能力。我们以开源的Goedel-Prover-V2模型为例,该模型在180万条形式数学数据上进行了强化训练。微调后,即使明确指示使用工具,模型的有效工具调用准确率也从基础模型的89.4%骤降至近乎0%。我们探讨这种代理能力崩溃是否可逆。通过仅在少量Lean特定工具使用数据上继续微调,结果发现:仅需100条代理轨迹即可显著恢复工具调用行为。重要的是,这种恢复并非奖励欺骗或基准优化所致——训练数据完全来自Lean环境,模型通过自然语言查询Mathlib库查找定理与引理,但恢复的能力能有效迁移至其他领域。在伯克利工具调用排行榜上,性能从近零提升至83.8%,接近原始模型的89.4%,尽管任务分布和协议存在差异。在证明数据集ProofNet上,pass@32得分从21.51%提升至25.81%。结果表明,深度领域微调虽压制通用工具使用能力,但并未永久抹除它;少量领域特定代理数据即可唤醒被抑制的能力。

原文摘要 · Abstract (English)

Heavy supervised fine-tuning on a target domain can strongly suppress capabilities that were present in the base model. We study this phenomenon in formal mathematics using Goedel-Prover-V2, an open-source model heavily trained on 1.8 million formal-math examples. After domain specialization, the model almost completely loses its ability to produce valid tool calls, even when explicitly instructed to use tools, dropping from 89.4% function-calling accuracy in the base model to nearly 0%. We ask whether this agentic collapse is permanent or instead reversible. To answer this question, we fine-tune the specialized model on a small amount of Lean-specific tool-use data. Remarkably, as few as 100 agentic traces are sufficient to restore strong tool-calling behavior. Importantly, this recovery is not the result of reward hacking or benchmark-specific optimization: the recovery data is entirely drawn from the Lean setting, where the model uses natural-language queries to search the Mathlib library for relevant theorems and lemmas, yet the regained capability transfers well beyond that domain. In particular, these same 100 Lean-specific traces improve performance on the Berkeley Function Calling Leaderboard from near zero to 83.8%, approaching the base model's 89.4% despite the mismatch in task distribution and protocol. The recovered capability is also practically useful in-domain. On ProofNet, pass@32 improves from 21.51% to 25.81%. Together, these results show that heavy domain supervised fine-tuning can suppress general tool-use ability without permanently erasing it, and that a small amount of domain-specific agentic data can awaken dormant tool-use capabilities.

大模型工具调用微调副作用知识迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。