模型会受自己旧判断影响,新方法可有效消除这种干扰。
Do SpeechLMs Hear Their Own Opinions? Diagnosing and Mitigating Previous-Belief Contamination in Streaming Emotion Understanding

- 用防火墙隔离历史状态,避免旧判断干扰当前感知
- 在证据支持下才引入历史信息,减少错误传递
- 无需训练,适合实时情绪识别场景
流式情绪理解通过持续使用历史状态来解释当前音频,常将模型的先前预测作为上下文。我们发现这种历史依赖会扭曲当前感知。在平衡的CREMA-D-Stream反事实诊断中,仅改变注入的前一情绪标签而固定音频,当前音频准确率从72.50%降至30.42%,65.69%的预测被反转。该效应显著标签不对称,先前信念拉力范围为4.76%至98.20%,揭示一种称为前信念污染(PBC)的失败。为此,我们提出EmoUpdate——一种无需训练的框架,通过三部分实现:(1) 前置盲声学防火墙,阻止历史状态进入感知;(2) 证据收缩因果信念过滤器,在形成观察后引入历史信息,并仅当有观测证据支持时保留标签不对称转移结构;(3) 基于相同反事实测量推导出的闭式去污染算子,用于无法防火墙的场景。在四个SpeechLM和两个流式情绪基准上,EmoUpdate在所有八个模型-基准设置中均取得最佳步骤准确率和状态平衡准确率,相比最强基线,提升最高达69.71点(S-BAcc)和38.41点(步准确率)。
原文摘要 · Abstract (English)
Streaming emotion understanding uses historical state while continuously interpreting current audio, often feeding the model's previous prediction back as context. We show that this history conditioning can distort current perception. On a balanced CREMA-D-Stream counterfactual diagnostic, changing only the injected previous emotion label while holding the audio fixed reduces current-audio accuracy from 72.50% to 30.42% and flips 65.69% of predictions. The effect is strongly label-asymmetric, with prior pull ranging from 4.76% to 98.20%, revealing a failure we call previous-belief contamination (PBC). To address PBC, we introduce EmoUpdate, a training-free framework that separates current-audio perception from historical state revision through three components: (1) a prior-blind acoustic firewall that prevents historical state from entering perception; (2) an evidence-shrunk causal belief filter that introduces history only after observation formation and retains label-asymmetric transition structure only when supported by observed evidence; and (3) a closed-form decontamination operator derived from the same counterfactual measurements for serving stacks where firewalling is unavailable. Across four SpeechLMs and two streaming emotion benchmarks, EmoUpdate achieves the best step accuracy and state-balanced accuracy in all eight model--benchmark settings, improving S-BAcc by up to 69.71 points and step accuracy by up to 38.41 points over the strongest controlled baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。