arXiv:2510.13291cs.CLcs.AI2025-10被引 6

美团用大模型打造智能客服系统,用户满意度升25%,成本降27%。

Higher Satisfaction, Lower Cost: A Technical Report on How LLMs Revolutionize Meituan's Intelligent Interaction Systems

  • 融合多智能体与大模型,实现自动任务管理与协作求解。
  • 上线后用户满意度提升25.51%,投诉率下降27.53%。
  • 适合需快速迭代、高个性化服务的互联网平台参考。

提升客户体验对业务成功至关重要,尤其在服务规模与复杂度持续增长的背景下。生成式AI与大语言模型(LLMs)使智能交互系统能提供高效、个性化、全天候支持。然而实际应用中仍面临五大挑战:(1)冷启动训练数据构建困难,制约系统自进化并增加人力成本;(2)多轮对话性能不佳,源于意图理解不足、规则合规性差与解决方案提取弱;(3)业务规则频繁变更影响系统可操作性与迁移能力,限制低成本扩展;(4)单一LLM在复杂场景下能力有限,缺乏多智能体协同框架导致流程不完整;(5)多轮对话开放域特性导致无统一标准答案,难以量化评估与持续优化。为此,我们提出针对工业场景的WOWService智能交互系统,结合大模型与多智能体架构,实现自主任务管理与协同问题解决。核心模块涵盖数据构建、通用能力增强、业务场景适配、多智能体协同与自动化评估。目前,WOWService已在美团App上线,关键指标显著提升:用户满意度指标1(USM 1)下降27.53%,用户满意度指标2(USM 2)上升25.51%,充分验证其在捕捉用户需求与推动个性化服务方面的有效性。

原文摘要 · Abstract (English)

Enhancing customer experience is essential for business success, particularly as service demands grow in scale and complexity. Generative artificial intelligence and Large Language Models (LLMs) have empowered intelligent interaction systems to deliver efficient, personalized, and 24/7 support. In practice, intelligent interaction systems encounter several challenges: (1) Constructing high-quality data for cold-start training is difficult, hindering self-evolution and raising labor costs. (2) Multi-turn dialogue performance remains suboptimal due to inadequate intent understanding, rule compliance, and solution extraction. (3) Frequent evolution of business rules affects system operability and transferability, constraining low-cost expansion and adaptability. (4) Reliance on a single LLM is insufficient in complex scenarios, where the absence of multi-agent frameworks and effective collaboration undermines process completeness and service quality. (5) The open-domain nature of multi-turn dialogues, lacking unified golden answers, hampers quantitative evaluation and continuous optimization. To address these challenges, we introduce WOWService, an intelligent interaction system tailored for industrial applications. With the integration of LLMs and multi-agent architectures, WOWService enables autonomous task management and collaborative problem-solving. Specifically, WOWService focuses on core modules including data construction, general capability enhancement, business scenario adaptation, multi-agent coordination, and automated evaluation. Currently, WOWService is deployed on the Meituan App, achieving significant gains in key metrics, e.g., User Satisfaction Metric 1 (USM 1) -27.53% and User Satisfaction Metric 2 (USM 2) +25.51%, demonstrating its effectiveness in capturing user needs and advancing personalized service.

智能客服大模型应用多智能体用户体验

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。