从用户评论中自动提取问题并生成可执行的改进建议。
Actionable Advice from Reviews via Mixture of LoRA Experts: A Two-LLM Pipeline for Issue Extraction and Business Recommendations
- 分两阶段:先识别问题主题,再基于问题生成具体建议。
- 用多专家低秩适配器提升建议质量,效率高于全量微调。
- 在航空与餐饮领域均表现更优,建议更具体、可行且无冗余。
用户评论包含服务失败和用户期望的详细领域信号,但将这些非结构化反馈转化为可操作的商业决策仍具挑战。本文研究从评论到行动的生成任务:基于评论文本生成具体可执行的建议。提出一种模块化双大模型框架,第一阶段由问题模型提取关键问题并分配粗粒度主题,第二阶段由建议模型根据提取的问题表示生成针对性运营改进方案。为实现专业化而无需昂贵的全量微调,采用多专家低秩适配器策略:训练多个低秩适配器,推理时通过轻量级门控机制进行令牌级专家混合,整合不同问题类型间的互补能力。基于Yelp评论(航空与餐饮)构建合成的评论-问题-建议三元组进行监督训练,并使用涵盖可操作性、具体性、可行性、预期影响、新颖性、非冗余性、偏见、清晰度共八维度的操作评估标准进行评测。在两个领域中,该方法持续优于仅提示和单适配器基线,显著提升建议的可操作性和具体性,同时保持良好的效率-质量平衡。
原文摘要 · Abstract (English)
Customer reviews contain detailed, domain specific signals about service failures and user expectations, but converting this unstructured feedback into actionable business decisions remains difficult. We study review-to-action generation: producing concrete, implementable recommendations grounded in review text. We propose a modular two-LLM framework in which an Issue model extracts salient issues and assigns coarse themes, and an Advice model generates targeted operational fixes conditioned on the extracted issue representation. To enable specialization without expensive full fine-tuning, we adapt the Advice model using a mixture of LoRA experts strategy: multiple low-rank adapters are trained and a lightweight gating mechanism performs token-level expert mixing at inference, combining complementary expertise across issue types. We construct synthetic review-issue-advice triples from Yelp reviews (airlines and restaurants) to supervise training, and evaluate recommendations using an eight dimension operational rubric spanning actionability, specificity, feasibility, expected impact, novelty, non-redundancy, bias, and clarity. Across both domains, our approach consistently outperforms prompting-only and single-adapter baselines, yielding higher actionability and specificity while retaining favorable efficiency-quality trade-offs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。