arXiv:2411.13187cs.LGcs.AI2024-11KDD被引 10

用强化学习让大模型生成能最大化社交互动的内容。

Engagement-Driven Content Generation with Large Language Models

  • 通过模拟网络反馈构建强化学习闭环,高效优化内容生成。
  • 在不同观点分布下验证,大模型能显著提升用户参与度。
  • 框架可适配多种社交场景,适合社会计算研究者使用。

大型语言模型(LLMs)在一对一交互中展现强大说服力,但在用户互联、意见动态复杂的社交网络中,其影响力仍待探索。本文回答核心问题:能否让LLM生成能最大化社交平台用户参与度的内容?为此,我们提出一种基于强化学习与模拟反馈的生成流程,通过形式化建模网络对内容的响应作为奖励信号,避免真实实验的时间成本与复杂性,实现模型与网络间的高效反馈循环。该方法可控制模型在网络中的位置及话题观点分布等内生因素。框架适应不同观点分布,且对具体参与度模型具有无关性,支持即插即用。我们利用此框架分析了不同条件下LLM生成社交内容的表现,展示了其在此任务中的全部潜力。实验代码已开源:https://github.com/mminici/Engagement-Driven-Content-Generation。

原文摘要 · Abstract (English)

Large Language Models (LLMs) demonstrate significant persuasive capabilities in one-on-one interactions, but their influence within social networks, where interconnected users and complex opinion dynamics pose unique challenges, remains underexplored. This paper addresses the research question: \emph{Can LLMs generate meaningful content that maximizes user engagement on social networks?} To answer this, we propose a pipeline using reinforcement learning with simulated feedback, where the network's response to LLM-generated content (i.e., the reward) is simulated through a formal engagement model. This approach bypasses the temporal cost and complexity of live experiments, enabling an efficient feedback loop between the LLM and the network under study. It also allows to control over endogenous factors such as the LLM's position within the social network and the distribution of opinions on a given topic. Our approach is adaptive to the opinion distribution of the underlying network and agnostic to the specifics of the engagement model, which is embedded as a plug-and-play component. Such flexibility makes it suitable for more complex engagement tasks and interventions in computational social science. Using our framework, we analyze the performance of LLMs in generating social engagement under different conditions, showcasing their full potential in this task. The experimental code is publicly available at https://github.com/mminici/Engagement-Driven-Content-Generation.

大模型社交互动强化学习内容生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。