arXiv:2608.11715cs.CLcs.AI2026-08

解决多语言下API调用参数语言不一致问题,监督微调效果优于强化学习。

When the API Speaks the Wrong Language: Revisiting Post-Training for Multilingual Tool Use

  • 通过监督微调提升参数语言一致性,改善多语言API调用可靠性。
  • 在一致模型选择下,微调性能接近甚至超过复杂强化学习方法。
  • 强化学习仅在泛化和多目标权衡上带来增量提升,适合特定场景使用。

大型语言模型(LLMs)在多语言环境下进行API调用时可靠性下降。一种常见故障是模型选择正确工具但生成的参数值语言不一致,我们称之为参数语言不匹配(ALM)。尽管语义正确,此类输出在操作上无效,且未被标准API调用指标捕捉。我们重新评估了缓解ALM的后训练策略,发现监督微调(SFT)在基准测试中表现优异,显著提升参数语言一致性和端到端函数调用准确率。在一致模型选择条件下,SFT性能可媲美甚至超越更复杂的强化学习(RL)方法。进一步考察基于结构化、参数感知奖励的强化学习是否带来额外收益:如组相对策略优化(GRPO)等方法虽能改善语言一致性并更好保留通用推理能力,但增益有限,主要体现在泛化和多目标权衡方面。总体而言,多语言API定位的大部分性能可通过精心设计的监督训练实现,而强化学习仅提供针对性而非根本性改进。

原文摘要 · Abstract (English)

The reliability of Large Language Models (LLMs) for API calling degrades in multilingual settings. A common failure occurs when a model selects the correct tool but generates argument values in an inconsistent language, which we term Argument Language Mismatch (ALM). Although semantically correct, such outputs are operationally invalid and not captured by standard API-calling metrics. We revisit post-training strategies for mitigating ALM and find that, in our benchmark, supervised fine-tuning (SFT) provides a strong baseline, substantially improving argument language consistency and end-to-end function call accuracy. Under consistent model selection, SFT achieves performance comparable to, and sometimes exceeding more complex reinforcement learning (RL) approaches. We further examine whether RL with structured, argument-aware rewards offers additional benefits. While methods such as Group Relative Policy Optimization (GRPO) can improve language consistency and better preserve general reasoning ability, these gains are incremental and most pronounced in generalization and multi-objective trade-offs. Overall, our results suggest that much of the performance in multilingual API grounding can be achieved through careful supervised training, with RL providing targeted rather than fundamental improvements.

多语言API调用监督微调语言一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。