arXiv:2504.03295cs.CLcs.AI2025-04被引 2

构建首个面向政治议题的图文立场可控生成数据集

Stance-Driven Multimodal Controlled Statement Generation: New Dataset and Task

  • 提出图文联合建模的立场引导生成框架
  • 在2024美国大选数据上实现高一致性立场控制
  • 适合研究政治传播与多模态内容生成者

在支持多元或争议性立场的表达需求下,可控文本生成对平台舆论引导、社会批判和信息传播至关重要。随着大语言模型的发展,针对特定立场的可控生成成为研究热点,但现有数据集多仅限纯文本,缺乏多模态内容与有效上下文,尤其在立场识别场景中。本文正式定义并研究了面向图文(文本+图像/视频)的立场驱动可控内容生成新任务:给定一个包含多模态信息的推文,模型生成具有指定立场的回应。为此,我们构建了首个专为政治话语中多模态立场可控文本生成设计的数据集——StanceGen2024,涵盖2024年美国总统选举期间的推文及用户评论,包含文本、图片、视频与立场标注,用于探究多模态政治内容如何影响立场表达。同时提出立场驱动多模态生成框架(SDMG),通过加权融合多模态特征与立场引导,提升语义一致性和立场控制能力。相关数据与代码已公开。

原文摘要 · Abstract (English)

Formulating statements that support diverse or controversial stances on specific topics is vital for platforms that enable user expression, reshape political discourse, and drive social critique and information dissemination. With the rise of Large Language Models (LLMs), controllable text generation towards specific stances has become a promising research area with applications in shaping public opinion and commercial marketing. However, current datasets often focus solely on pure texts, lacking multimodal content and effective context, particularly in the context of stance detection. In this paper, we formally define and study the new problem of stance-driven controllable content generation for tweets with text and images, where given a multimodal post (text and image/video), a model generates a stance-controlled response. To this end, we create the Multimodal Stance Generation Dataset (StanceGen2024), the first resource explicitly designed for multimodal stance-controllable text generation in political discourse. It includes posts and user comments from the 2024 U.S. presidential election, featuring text, images, videos, and stance annotations to explore how multimodal political content shapes stance expression. Furthermore, we propose a Stance-Driven Multimodal Generation (SDMG) framework that integrates weighted fusion of multimodal features and stance guidance to improve semantic consistency and stance control. We release the dataset and code (https://anonymous.4open.science/r/StanceGen-BE9D) for public use and further research.

多模态生成立场控制政治传播数据集

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。