arXiv:2608.25379cs.CLcs.AI2026-08

动态检测大模型推理中的偏见,及时纠正但不干扰正确推理。

Adaptive Triggering for Bias Correction in LLM Reasoning

论文配图:Adaptive Triggering for Bias Correction in LLM Reasoning
图 1 · 摘自论文原文
  • 通过在线变化点检测决定何时干预,避免过早或过晚修正。
  • 使用预设阈值触发修正,自适应黑盒/白盒信号,减少干预次数。
  • 在多个模型上提升模糊情境准确率,适合需要高可靠性推理的场景。

思维链提示会暴露并放大大语言模型中间推理中的种族刻板印象,导致仅靠最终答案去偏无法解决的问题。生成过程中的去偏面临根本性的时机难题:干预过晚会使偏见传播,而过度干预可能破坏原本正确的推理。现有方法大多回避此问题,要么事后评估完整推理链,要么在固定步骤干预,未明确何时发展中的推理轨迹足以支持修正。本文将该决策建模为在线变化点检测问题:每步更新偏见信号以计算CUSUM统计量,仅当累积证据超过基于保留数据校准的阈值时才注入针对性修正。我们基于下一个词概率设计白盒信号,并采用大模型判别器获取黑盒信号,支持开源与托管模型部署。在gpt-4o-mini上,自适应黑盒触发在保持多数去歧义情境准确率的同时,显著减少了干预次数;即使使用独立判别器也表现稳定。在六个开源模型中,白盒信号提升了所有六种模型的模糊项准确率,但在五种模型中降低了去歧义项准确率,因其无法区分错误依赖刻板印象与正确符合刻板印象的证据。

原文摘要 · Abstract (English)

Chain-of-thought prompting can expose and amplify demographic stereotypes within an LLM's intermediate reasoning and create a failure mode that final-answer debiasing alone cannot address. Mitigating such bias during generation presents a fundamental timing problem: intervening too late allows biased reasoning to propagate, while unnecessarily intervening can disrupt otherwise correct reasoning. Existing approaches largely avoid this decision by either evaluating completed reasoning chains post hoc or intervening at predetermined steps, leaving open when a developing reasoning trajectory provides sufficient evidence to warrant correction. We formulate this decision as an online change-point detection problem. A per-step bias signal updates a CUSUM statistic and a targeted correction is injected only when accumulated evidence crosses a detector-specific threshold calibrated on held-out data. We instantiate the framework with a white-box signal derived from next-token probabilities and a black-box signal obtained from an LLM judge, enabling deployment with both open-weight and hosted models. On gpt-4o-mini adaptive black-box triggering recovers most of the disambiguated-context accuracy lost under fixed-interval intervention while requiring substantially fewer interventions. That result holds even with an independent judge. Across six open-weight models, the white-box signal improves ambiguous-item accuracy on all six but reduces disambiguated-item accuracy on five because it cannot distinguish unsupported stereotype reliance from correct, stereotype-congruent evidence.

大模型去偏推理优化自适应干预链式思维

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。