用非合作式多智能体模拟人类创作,提升诗歌多样性。
LLM-based multi-agent poetry generation in non-cooperative environments
- 引入非合作交互机制,模仿人类社会学习过程。
- 训练型模型诗歌多样性提升3.0-3.7个百分点,新颖性提升5.6-11.3个百分点。
- 适合关注创意生成多样性的研究人员和艺术应用开发者。
尽管大型语言模型在自动诗歌生成方面取得显著进展,但生成的诗歌缺乏多样性,且训练过程与人类学习方式差异较大。为使诗歌生成系统的学习过程更贴近人类,并提升输出的多样性和新颖性,我们提出一种基于社会学习的框架,强调非合作互动以促进多样性。本研究首次在非合作环境中探索基于LLM的多智能体系统用于诗歌生成,涵盖训练型(GPT-2)和提示型(GPT-3、GPT-4)智能体。基于96,000首生成诗歌的评估显示,训练型智能体在该框架下实现3.0-3.7个百分点的多样性提升和5.6-11.3个百分点的新颖性提升(基于独特及新颖n-gram)。生成诗歌在词汇、风格和语义层面呈现群体分歧特征。提示型智能体也受益于非合作环境,异质智能体集合可进一步增强多样性,提升达7.0-17.5个百分点。然而,提示型智能体随时间出现词汇多样性下降,未呈现预期的群体分化。本文主张在自动诗歌生成等创造性任务中,应引入类人类的社会学习机制(通过基于LLM的智能体建模),实现范式转变。
原文摘要 · Abstract (English)
Despite substantial progress of large language models (LLMs) for automatic poetry generation, the generated poetry lacks diversity while the training process differs greatly from human learning. Under the rationale that the learning process of the poetry generation systems should be more human-like and their output more diverse and novel, we introduce a framework based on social learning where we emphasize non-cooperative interactions besides cooperative interactions to encourage diversity. Our experiments are the first attempt at LLM-based multi-agent systems in non-cooperative environments for poetry generation employing both TRAINING-BASED agents (GPT-2) and PROMPTING-BASED agents (GPT-3 and GPT-4). Our evaluation based on 96k generated poems shows that our framework benefits the poetry generation process for TRAINING-BASED agents resulting in 1) a 3.0-3.7 percentage point (pp) increase in diversity and a 5.6-11.3 pp increase in novelty according to distinct and novel n-grams. The generated poetry from TRAINING-BASED agents also exhibits group divergence in terms of lexicons, styles and semantics. PROMPTING-BASED agents in our framework also benefit from non-cooperative environments and a more diverse ensemble of models with non-homogeneous agents has the potential to further enhance diversity, with an increase of 7.0-17.5 pp according to our experiments. However, PROMPTING-BASED agents show a decrease in lexical diversity over time and do not exhibit the group-based divergence intended in the social network. Our paper argues for a paradigm shift in creative tasks such as automatic poetry generation to include social learning processes (via LLM-based agent modeling) similar to human interaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。