用大模型模拟社交网络,测试推荐系统对用户参与和观点极化的影响。
Towards Recommender Systems LLMs Playground (RecSysLLMsP): Exploring Polarization and Engagement in Simulated Social Networks
- 构建基于大模型的虚拟用户,模拟三种推荐策略下的行为。
- 按偏好推荐最能提升参与度,但易形成信息茧房。
- 适合研究推荐算法社会影响的学者与平台安全团队。
随着AI技术飞速发展,推荐系统可能带来的负面影响亟需提前模拟评估,以避免对社会及企业造成损害。本文提出推荐系统大模型沙盒(RecSysLLMsP),利用大语言模型创建具有描述性、静态和动态属性的多样化AI代理(AgentPrompts),在三种场景——多数派(Plurality)、平衡(Balanced)与相似性(Similarity)下评估其自主行为。结果显示,相似性场景(按用户偏好推荐)虽显著提升参与度,但可能加剧观点极化;多数派场景促进多元互动,但参与度表现不一。研究强调需在用户体验与社会风险间取得平衡,并指出将大模型引入仿真环境的独特价值与挑战。该框架可量化极化效应,对评估推荐系统社会影响及优化商业模型至关重要。未来需验证虚拟用户与真实人类行为的一致性,并建立可靠的极化评分指标。
原文摘要 · Abstract (English)
Given the exponential advancement in AI technologies and the potential escalation of harmful effects from recommendation systems, it is crucial to simulate and evaluate these effects early on. Doing so can help prevent possible damage to both societies and technology companies. This paper introduces the Recommender Systems LLMs Playground (RecSysLLMsP), a novel simulation framework leveraging Large Language Models (LLMs) to explore the impacts of different content recommendation setups on user engagement and polarization in social networks. By creating diverse AI agents (AgentPrompts) with descriptive, static, and dynamic attributes, we assess their autonomous behaviour across three scenarios: Plurality, Balanced, and Similarity. Our findings reveal that the Similarity Scenario, which aligns content with user preferences, maximizes engagement while potentially fostering echo chambers. Conversely, the Plurality Scenario promotes diverse interactions but produces mixed engagement results. Our study emphasizes the need for a careful balance in recommender system designs to enhance user satisfaction while mitigating societal polarization. It underscores the unique value and challenges of incorporating LLMs into simulation environments. The benefits of RecSysLLMsP lie in its potential to calculate polarization effects, which is crucial for assessing societal impacts and determining user engagement levels with diverse recommender system setups. This advantage is essential for developing and maintaining a successful business model for social media companies. However, the study's limitations revolve around accurately emulating reality. Future efforts should validate the similarity in behaviour between real humans and AgentPrompts and establish metrics for measuring polarization scores.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。