arXiv:2505.15095cs.CLcs.AI2025-05被引 1

用认知启发提示提升澳印英语讽刺检测可解释性

Nek Minit: Harnessing Pragmatic Metacognitive Prompting for Explainable Sarcasm Detection of Australian and Indian English

  • 采用认知启发式提示生成讽刺解释,增强模型理解力
  • 在GEMMA和LLAMA上表现显著优于四种提示策略
  • 适合需要可解释讽刺识别的跨地域语言应用

讽刺因其表层与隐含情感不一致而挑战情感分析,尤其在涉及特定国家或地区语境时更为突出。本文将实用型元认知提示(PMP)应用于澳大利亚和印度英语的可解释讽刺检测,并构建了包含讽刺解释的BESSTIE数据集,与已有标准英语数据集FLUTE进行对比。在两个开源大模型(GEMMA和LLAMA)上,所提方法在所有任务和数据集上均显著优于四种替代提示策略。此外,代理式提示通过外部知识检索缓解上下文依赖问题。本研究的核心贡献在于将PMP用于不同英语变体的讽刺解释生成。

原文摘要 · Abstract (English)

Sarcasm is a challenge to sentiment analysis because of the incongruity between stated and implied sentiment. The challenge is exacerbated when the implication may be relevant to a specific country or geographical region. Pragmatic metacognitive prompting (PMP) is a cognition-inspired technique that has been used for pragmatic reasoning. In this paper, we harness PMP for explainable sarcasm detection for Australian and Indian English, alongside a benchmark dataset for standard English. We manually add sarcasm explanations to an existing sarcasm-labeled dataset for Australian and Indian English called BESSTIE, and compare the performance for explainable sarcasm detection for them with FLUTE, a standard English dataset containing sarcasm explanations. Our approach utilising PMP when evaluated on two open-weight LLMs (GEMMA and LLAMA) achieves statistically significant performance improvement across all tasks and datasets when compared with four alternative prompting strategies. We also find that alternative techniques such as agentic prompting mitigate context-related failures by enabling external knowledge retrieval. The focused contribution of our work is utilising PMP in generating sarcasm explanations for varieties of English.

讽刺检测可解释AI多语言NLP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。