用新格式重写客服流程,让大模型更懂业务。
LLM-Friendly Knowledge Representation for Customer Support
- 将政策流程转为意图-上下文-动作格式,提升大模型理解力。
- 自动生成训练数据,大幅降低人工标注成本。
- 提升准确率与处理效率,适合想低成本落地的团队。
本文提出一种实用方法,将大语言模型(LLMs)与专为爱彼迎客户支持运营设计的框架结合。通过创新的意图、上下文和动作(ICA)格式重写技术,将政策与工作流转化为更易被大模型理解的结构。同时,开发了一种合成数据生成策略,以最少的人工干预生成训练数据,实现低成本微调。内部实验(未应用于爱彼迎产品)表明,重构工作流并用合成数据微调大模型,显著提升了性能,树立了在客户支持中应用大模型的新基准。该方案不仅成本低,还通过准确率和人工处理时间等指标验证了对客户服务的实际改善。
原文摘要 · Abstract (English)
We propose a practical approach by integrating Large Language Models (LLMs) with a framework designed to navigate the complexities of Airbnb customer support operations. In this paper, our methodology employs a novel reformatting technique, the Intent, Context, and Action (ICA) format, which transforms policies and workflows into a structure more comprehensible to LLMs. Additionally, we develop a synthetic data generation strategy to create training data with minimal human intervention, enabling cost-effective fine-tuning of our model. Our internal experiments (not applied to Airbnb products) demonstrate that our approach of restructuring workflows and fine-tuning LLMs with synthetic data significantly enhances their performance, setting a new benchmark for their application in customer support. Our solution is not only cost-effective but also improves customer support, as evidenced by both accuracy and manual processing time evaluation metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。