arXiv:2601.00086cs.CL2026-01ACL被引 2

让大模型学会自动生成可复用的工具使用规则,提升在新场景下的可靠性。

RIMRULE: Improving Tool-Using Language Agents via MDL-Guided Rule Learning

  • 通过分析失败案例自动生成简洁可解释的规则,注入推理提示中。
  • 在已见和未见工具上均提升准确率,最高达82.3%。
  • 规则可跨模型复用,适合需要快速适配新工具的场景。

大型语言模型在特定领域使用工具时经常表现不佳,因API可能独特、文档不足或针对私有流程定制。这凸显了对任务特定工具有效适应的必要性。我们提出RIMRULE,一种基于动态规则注入的神经符号方法,用于改进大模型的适应能力。从失败轨迹中提炼出紧凑且可解释的规则,并在推理时注入提示以提升任务性能。这些规则由语言模型自身生成,通过最小描述长度(MDL)目标进行整合,以优先考虑通用性和简洁性。每条规则同时以自然语言和结构化符号形式存储,支持高效检索。在工具使用基准上的实验表明,该方法在不修改模型权重的情况下提升了已见与未见工具的准确率。其表现优于基于提示的适应方法,并能与微调互补。此外,从一个模型学习到的规则可被用于提升其他模型,包括长推理大模型,展示了符号知识在不同架构间的可移植性。

原文摘要 · Abstract (English)

Large language models (LLMs) often struggle to use tools reliably in domain-specific settings, where APIs may be idiosyncratic, under-documented, or tailored to private workflows. This highlights the need for effective adaptation to task-specific tools. We propose RIMRULE, a neuro-symbolic approach for LLM adaptation based on dynamic rule injection. Compact, interpretable rules are distilled from failure traces and injected into the prompt during inference to improve task performance. These rules are proposed by the LLM itself and consolidated using a Minimum Description Length (MDL) objective that favors generality and conciseness. Each rule is stored in both natural language and a structured symbolic form, supporting efficient retrieval at inference time. Experiments on tool-use benchmarks show that this approach improves accuracy on both seen and unseen tools without modifying LLM weights. It outperforms prompting-based adaptation methods and complements finetuning. Moreover, rules learned from one LLM can be reused to improve others, including long reasoning LLMs, highlighting the portability of symbolic knowledge across architectures.

大模型工具使用规则学习神经符号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。