arXiv:2508.07690cs.CLcs.AI2025-08被引 3

让大模型学会用逻辑推理来发现新工具,无需重新训练

LoSemB: Logic-Guided Semantic Bridging for Inductive Tool Retrieval

  • 通过逻辑信息对齐,缓解新工具带来的分布偏移
  • 引入关系增强检索,降低相似度匹配的脆弱性
  • 适合需要持续接入新工具的实时应用系统

工具学习已成为大语言模型解决现实任务的有前景范式。然而,随着工具库快速扩张,将所有工具纳入模型有限输入长度不切实际。现有方法多在归纳设置下运行,假设训练时已见过所有工具,这与真实世界工具库持续演化、频繁新增新工具的情况不符。面对未见工具(训练中未遇到的工具),现有方法面临两大问题:显著的分布偏移和基于相似性的检索易受干扰。受人类通过已有经验发现并应用逻辑信息掌握新工具的启发,本文提出一种新型归纳式工具检索框架 LoSemB(Logic-Guided Semantic Bridging)。LoSemB 通过逻辑嵌入对齐模块缓解分布偏移,并设计关系增强检索机制降低相似性匹配的脆弱性,从而在无需代价高昂重训练的前提下,挖掘并迁移潜在逻辑信息以实现归纳式工具检索。大量实验表明,LoSemB 在归纳设置下达到先进性能,同时在归纳设置下保持良好有效性。

原文摘要 · Abstract (English)

Tool learning has emerged as a promising paradigm for large language models (LLMs) to solve many real-world tasks. Nonetheless, with the tool repository rapidly expanding, it is impractical to contain all tools within the limited input length of LLMs. To alleviate these issues, researchers have explored incorporating a tool retrieval module to select the most relevant tools or represent tools as unique tokens within LLM parameters. However, most state-of-the-art methods are under transductive settings, assuming all tools have been observed during training. Such a setting deviates from reality as the real-world tool repository is evolving and incorporates new tools frequently. When dealing with these unseen tools, which refer to tools not encountered during the training phase, these methods are limited by two key issues, including the large distribution shift and the vulnerability of similarity-based retrieval. To this end, inspired by human cognitive processes of mastering unseen tools through discovering and applying the logical information from prior experience, we introduce a novel Logic-Guided Semantic Bridging framework for inductive tool retrieval, namely, LoSemB, which aims to mine and transfer latent logical information for inductive tool retrieval without costly retraining. Specifically, LoSemB contains a logic-based embedding alignment module to mitigate distribution shifts and implements a relational augmented retrieval mechanism to reduce the vulnerability of similarity-based retrieval. Extensive experiments demonstrate that LoSemB achieves advanced performance in inductive settings while maintaining desirable effectiveness in the transductive setting.

工具学习归纳推理大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。