用因果推理提升大模型隐含情感分析的准确性与鲁棒性
Causal Prompting for Implicit Sentiment Analysis with Large Language Models
- 引入前门调整机制,拆解提示词与推理链对输出的影响
- 在多个基准数据集上显著优于传统提示方法,尤其抗干扰能力强
- 适合关注模型公平性与深层语义推理的研究者
隐含情感分析(ISA)旨在推断未明确表达的情感,需模型基于细微上下文线索进行深度推理。尽管近期基于大语言模型(LLMs)的提示方法在ISA中展现出潜力,但通常依赖链式思维(CoT)推理路径的多数投票,未评估其因果有效性,易受内部偏差和虚假相关影响。为此,我们提出CAPITAL框架,将前门调整融入CoT推理。CAPITAL将整体因果效应分解为输入提示对推理链的影响,以及推理链对最终输出的作用,分别通过编码器聚类和NWGM近似估计,并采用对比学习目标使编码器表示更贴近LLM推理空间。在三个基准ISA数据集上使用三类LLMs的实验表明,CAPITAL在准确率与鲁棒性上均持续优于强基线,尤其在对抗条件下表现突出。该工作为将因果推断融入LLM提示提供了系统方法,并凸显其在抗偏见情感推理中的价值。源码与案例研究见:https://github.com/whZ62/CAPITAL。
原文摘要 · Abstract (English)
Implicit Sentiment Analysis (ISA) aims to infer sentiment that is implied rather than explicitly stated, requiring models to perform deeper reasoning over subtle contextual cues. While recent prompting-based methods using Large Language Models (LLMs) have shown promise in ISA, they often rely on majority voting over chain-of-thought (CoT) reasoning paths without evaluating their causal validity, making them susceptible to internal biases and spurious correlations. To address this challenge, we propose CAPITAL, a causal prompting framework that incorporates front-door adjustment into CoT reasoning. CAPITAL decomposes the overall causal effect into two components: the influence of the input prompt on the reasoning chains, and the impact of those chains on the final output. These components are estimated using encoder-based clustering and the NWGM approximation, with a contrastive learning objective used to better align the encoder's representation with the LLM's reasoning space. Experiments on benchmark ISA datasets with three LLMs demonstrate that CAPITAL consistently outperforms strong prompting baselines in both accuracy and robustness, particularly under adversarial conditions. This work offers a principled approach to integrating causal inference into LLM prompting and highlights its benefits for bias-aware sentiment reasoning. The source code and case study are available at: https://github.com/whZ62/CAPITAL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。