用大模型帮用户写更全面的产品评论,提升质量与效率
CPR: Leveraging LLMs for Topic and Phrase Suggestion to Facilitate Comprehensive Product Reviews
- 用大模型和主题建模分三步引导用户写出有观点、有细节的评论
- 对无历史评论的新产品也能识别关键术语,生成贴合情感的短语建议
- 实测可提升12.3%的文本相似度,适合想高效写好评的消费者
消费者常依赖在线产品评论,通过评分和文字描述评估产品质量。但现有研究未能系统性推动用户撰写涵盖情感与功能细节的全面评论。本文提出CPR,一种利用大语言模型(LLMs)与主题建模来引导用户创作深刻、全面评论的新方法。该方法包含三个阶段:首先向用户提供与产品相关的评价词汇;其次基于评分生成针对性短语建议;最后通过主题建模整合用户撰写内容,确保覆盖关键方面。我们采用文本到文本的LLM进行评估,对比沃尔玛真实客户评论。结果表明,CPR能有效识别新产品的相关术语,并提供与情感一致的短语建议,显著节省用户时间并提升评论质量。定量分析显示,其在BLEU分数上比基线方法提升12.3%,人工评估也证实生成短语的有效性。论文最后讨论了未来扩展方向。
原文摘要 · Abstract (English)
Consumers often heavily rely on online product reviews, analyzing both quantitative ratings and textual descriptions to assess product quality. However, existing research hasn't adequately addressed how to systematically encourage the creation of comprehensive reviews that capture both customers sentiment and detailed product feature analysis. This paper presents CPR, a novel methodology that leverages the power of Large Language Models (LLMs) and Topic Modeling to guide users in crafting insightful and well-rounded reviews. Our approach employs a three-stage process: first, we present users with product-specific terms for rating; second, we generate targeted phrase suggestions based on these ratings; and third, we integrate user-written text through topic modeling, ensuring all key aspects are addressed. We evaluate CPR using text-to-text LLMs, comparing its performance against real-world customer reviews from Walmart. Our results demonstrate that CPR effectively identifies relevant product terms, even for new products lacking prior reviews, and provides sentiment-aligned phrase suggestions, saving users time and enhancing reviews quality. Quantitative analysis reveals a 12.3% improvement in BLEU score over baseline methods, further supported by manual evaluation of generated phrases. We conclude by discussing potential extensions and future research directions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。