arXiv:2503.01940cs.CLcs.AI2025-03EMNLP被引 15

让大模型自我修正提问,更准更高效地调用工具

AskToAct: Enhancing LLMs Tool Use via Self-Correcting Clarification

  • 通过删除查询中的关键参数自动生成训练数据
  • 可识别并纠正多轮对话中的错误,提升准确率超57%
  • 无需额外训练即可适配新接口,适合低资源部署

大型语言模型在工具学习方面表现出色。现实场景中用户查询常模糊不全,需有效澄清。现有交互式澄清方法存在两大局限:依赖人工构建数据集,限制了训练数据规模与多样性;多轮澄清过程中缺乏纠错机制,导致错误累积,影响准确率与效率。我们提出 AskToAct,利用查询与工具调用方案之间的结构映射关系。核心思想是工具参数天然代表明确的用户意图。通过系统性移除查询中的关键参数而保留其作为真实标签,实现高质量训练数据的自动化构建。进一步通过纠错对与选择性掩码增强模型鲁棒性,实现在澄清交互中动态检测错误。全面实验表明,AskToAct 显著优于现有方法,在恢复关键未指定意图上准确率超过57%,澄清效率平均提升10.46%,同时保持高工具调用准确率。该框架在不同模型架构下表现稳健,并成功泛化至完全未见过的 API 而无需额外训练,性能接近 GPT-4o,但计算资源消耗显著更低。

原文摘要 · Abstract (English)

Large language models (LLMs) have demonstrated remarkable capabilities in tool learning. In real-world scenarios, user queries are often ambiguous and incomplete, requiring effective clarification. However, existing interactive clarification approaches face two critical limitations: reliance on manually constructed datasets, which inherently constrains training data scale and diversity, and lack of error correction mechanisms during multi-turn clarification, leading to error accumulation that compromises both accuracy and efficiency. We present AskToAct, which addresses these challenges by exploiting the structural mapping between queries and their tool invocation solutions. Our key insight is that tool parameters naturally represent explicit user intents. By systematically removing key parameters from queries while retaining them as ground truth, we enable automated construction of high-quality training data. We further enhance model robustness through error-correction pairs and selective masking, enabling dynamic error detection during clarification interactions. Comprehensive experiments demonstrate that AskToAct significantly outperforms existing approaches, achieving above 57% accuracy in recovering critical unspecified intents and enhancing clarification efficiency by an average of 10.46% while maintaining high accuracy in tool invocation. Our framework exhibits robust performance across different model architectures and successfully generalizes to entirely unseen APIs without additional training, achieving performance comparable to GPT-4o with substantially fewer computational resources.

大模型工具调用自我修正零样本泛化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。