arXiv:2503.01870cs.CLcs.AI2025-03被引 4

用大模型自动识别客户需求,准确率超人工。

Transforming the Voice of the Customer: Large Language Models for Identifying Customer Needs

  • 微调大模型自动提取客户需求,替代人工分析。
  • 微调模型表现不低于专业分析师,远超基础模型。
  • 结果精准且可解释,适合企业创新与市场研究。

识别客户需要(CNs)是产品创新与营销策略的核心。然而,过去三十年的客户之声(VOC)应用一直依赖专业分析师手动解读定性数据并提炼“待完成的任务”。这一过程认知负担重、耗时长且难以扩展。尽管现有方法使用机器学习筛选内容,但关键的客户需求精确表述仍需专家判断。我们通过多轮研究评估大型语言模型(LLMs)在自动化客户需要抽象方面的可行性。在多个产品与服务类别中,监督微调(SFT)的LLMs表现至少与专业分析师相当,并显著优于基础模型。该效果在不同基础模型上具有泛化性,且仅需相对较小的模型规模。抽象出的需求表述精准、足够具体以指导创新,且基于原始文本,无幻觉现象。分析表明,SFT训练使模型习得专业需求表述的句法与语义规律,而非简单记忆。自动化繁琐任务重塑了VOC方法,实现规模化发现高价值洞察,并让分析师聚焦更高附加值工作。

原文摘要 · Abstract (English)

Identifying customer needs (CNs) is fundamental to product innovation and marketing strategy. Yet for over thirty years, Voice-of-the-Customer (VOC) applications have relied on professional analysts to manually interpret qualitative data and formulate "jobs to be done." This task is cognitively demanding, time-consuming, and difficult to scale. While current practice uses machine learning to screen content, the critical final step of precisely formulating CNs relies on expert human judgment. We conduct a series of studies with market research professionals to evaluate whether Large Language Models (LLMs) can automate CN abstraction. Across various product and service categories, we demonstrate that supervised fine-tuned (SFT) LLMs perform at least as well as professional analysts and substantially better than foundational LLMs. These results generalize to alternative foundational LLMs and require relatively "small" models. The abstracted CNs are well-formulated, sufficiently specific to guide innovation, and grounded in source content without hallucination. Our analysis suggests that SFT training enables LLMs to learn the underlying syntactic and semantic conventions of professional CN formulation rather than relying on memorized CNs. Automation of tedious tasks transforms the VOC approach by enabling the discovery of high-leverage insights at scale and by refocusing analysts on higher-value-added tasks.

客户洞察大模型应用需求识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。