arXiv:2601.02362cs.IRcs.AI2026-01

AI生成的评价会影响推荐系统表现,平台控制策略至关重要。

The Impact of LLM-Generated Reviews on Recommender Systems: Textual Shifts, Performance Effects, and Strategic Platform Control

  • 区分用户用AI润色与平台直接生成两类内容影响
  • 真人训练模型性能优于纯AI训练,且能更好适应AI内容
  • 平台通过语气策略提升合成评价效果,适合平台方参考

生成式AI正在重塑基于文本的推荐系统,使其同时面临人工与AI生成内容。本研究分析了两种路径:用户使用AI工具优化个人评论,或平台基于结构化数据直接生成合成评论。基于TripAdvisor的酒店评论大规模数据集,我们利用大语言模型生成合成评论,并评估其在推荐系统训练与部署阶段的影响。结果发现,AI生成评论在多个文本维度上系统性区别于人工评论。尽管两类AI内容均提升模型性能,但以真人评论训练的模型始终表现更优,说明真实数据质量更高。真人训练模型对AI内容具有强泛化能力,而纯AI训练模型在两类内容上均表现不佳。此外,鼓励、建设性或批判性语气策略显著增强平台生成评论的效果。研究凸显平台对合成内容生成与整合的策略控制对推荐鲁棒性与商业可持续性的关键作用。

原文摘要 · Abstract (English)

The rise of generative AI technologies is reshaping content-based recommender systems (RSes), which increasingly encounter AI-generated content alongside human-authored content. This study examines how the introduction of AI-generated reviews influences RS performance and business outcomes. We analyze two distinct pathways through which AI content can enter RSes: user-centric, in which individuals use AI tools to refine their reviews, and platform-centric, in which platforms generate synthetic reviews directly from structured metadata. Using a large-scale dataset of hotel reviews from TripAdvisor, we generate synthetic reviews using LLMs and evaluate their impact across the training and deployment phases of RSes. We find that AI-generated reviews differ systematically from human-authored reviews across multiple textual dimensions. Although both user- and platform-centric AI reviews enhance RS performance relative to models without textual data, models trained on human reviews consistently achieve superior performance, underscoring the quality of authentic human data. Human-trained models generalize robustly to AI content, whereas AI-trained models underperform on both content types. Furthermore, tone-based framing strategies (encouraging, constructive, or critical) substantially enhance platform-generated review effectiveness. Our findings highlight the strategic importance of platform control in governing the generation and integration of AI-generated reviews, ensuring that synthetic content complements recommendation robustness and sustainable business value.

推荐系统AI生成内容平台策略

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。