arXiv:2505.10495cs.LGcs.CL2025-05被引 2

用路由架构生成逼真函数调用数据,让大模型在无真实数据时也能精准调API。

RouteNator: A Router-Based Multi-Modal Architecture for Generating Synthetic Training Data for Function Calling LLMs

  • 通过路由机制融合元数据与多模态模型生成合成数据
  • 在真实查询上实现函数分类准确率显著提升
  • 适合缺乏用户数据但需高精度函数调用的场景

本文针对缺乏真实用户交互数据时微调大语言模型(LLMs)进行函数调用任务的难题提出解决方案。在数字内容创作工具中,用户通过自然语言表达需求,需映射为API调用,但真实任务数据稀缺且受隐私限制,需依赖合成数据。现有方法生成的数据多样性与复杂性不足,难以模拟真实分布,导致微调后性能不佳。我们提出一种基于路由器的多模态架构,利用内容元数据、结构化知识图谱,结合文本到文本和视觉到文本的语言模型,生成高质量合成训练数据。其灵活的路由机制可生成匹配真实世界分布的合成数据,突破传统方法的根本局限。在一组真实用户查询上的评估显示,使用该合成数据微调的模型在函数分类准确率与API参数选择上均有显著提升,性能持续优于传统方法,建立了函数调用任务的新基准。

原文摘要 · Abstract (English)

This paper addresses fine-tuning Large Language Models (LLMs) for function calling tasks when real user interaction data is unavailable. In digital content creation tools, where users express their needs through natural language queries that must be mapped to API calls, the lack of real-world task-specific data and privacy constraints for training on it necessitate synthetic data generation. Existing approaches to synthetic data generation fall short in diversity and complexity, failing to replicate real-world data distributions and leading to suboptimal performance after LLM fine-tuning. We present a novel router-based architecture that leverages domain resources like content metadata and structured knowledge graphs, along with text-to-text and vision-to-text language models to generate high-quality synthetic training data. Our architecture's flexible routing mechanism enables synthetic data generation that matches observed real-world distributions, addressing a fundamental limitation of traditional approaches. Evaluation on a comprehensive set of real user queries demonstrates significant improvements in both function classification accuracy and API parameter selection. Models fine-tuned with our synthetic data consistently outperform traditional approaches, establishing new benchmarks for function calling tasks.

函数调用合成数据多模态路由架构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。