arXiv:2607.03981cs.CLcs.AI2026-07中稿 · 6th International …

首个针对孟加拉语表情包的解释性证据检测数据集与模型。

BanglaMemeEvidence: A Multimodal Benchmark Dataset for Explanatory Evidence Detection in Bengali Memes

论文配图:BanglaMemeEvidence: A Multimodal Benchmark Dataset for Explanatory Evidence Detection in Bengali Memes
图 1 · 摘自论文原文
  • 构建多模态数据集,融合文本、图像和上下文信息。
  • 提出混合模型,在孟加拉语表情包上实现0.74的F1分数。
  • 填补低资源语言表情包分析空白,适合本地化内容安全研究。

表情包已成为社交媒体中极具影响力的传播工具,结合流行视觉与简明文字传递深刻观点。尽管已有大量研究关注其情感维度,但识别有害内容、网络欺凌及准确进行情感分析仍面临挑战,主要源于对深层语境理解的需求。本文提出MemeEvidenceDetect任务,旨在分析表情包及其上下文信息,识别解释其含义或幽默感的具体句子。为此,我们构建了包含2,917个孟加拉语表情包的高质量数据集BanglaMemeEvidence,每条数据均标注自然语言解释,包括表情包OCR内容、上下文信息与证据句,并附有反映相关性的评分。为应对动态推断表情包上下文的难题,我们设计BengaliMemeEvidenceNet,一种融合文本与视觉特征的混合多模态框架,实现全面的表情包表征。实验表明该模型在任务上达到0.74的F1分数。据我们所知,这是首个聚焦孟加拉语表情包证据检测的研究,为低资源语言中的表情包分析迈出了重要一步。

原文摘要 · Abstract (English)

Memes have become influential communication tools on social media, combining viral visuals with concise messaging to convey impactful ideas. While substantial research has examined the affective dimensions of memes, key challenges such as detecting harmful content, identifying cyberbullying, and performing accurate sentiment analysis remain critical, largely due to the need for deeper contextual understanding. In this paper, we introduce MemeEvidenceDetect, a hybrid task aimed at analyzing a meme and its contextual information to identify specific sentences that explain or elucidate its meaning and humor. To support this task, we present BanglaMemeEvidence, a curated dataset of 2,917 Bengali memes, emphasizing its significance as a resource for the Bangla language. Each meme is annotated with natural language explanations, including Meme OCR, Meme Context, and Evidence Sentences, alongside relevance scores that reflect the relationship between a meme and its corresponding annotations. To address the gap in dynamically inferring a meme's context, we propose BengaliMemeEvidenceNet, a hybrid multimodal framework that integrates textual and visual features for comprehensive meme representation. Our experiments demonstrate the effectiveness of BengaliMemeEvidenceNet, achieving an F1 score of 0.74. To the best of our knowledge, this is the first study to focus on evidence detection in Bengali memes, marking a notable step forward in the analysis of memes in low-resource languages.

表情包分析多模态低资源语言证据检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。