通过推理时干预提升大模型毒性判断公平性,避免对不同群体的误判。
When to Invoke: Refining LLM Fairness with Toxicity Assessment
- 在推理阶段动态识别可能产生偏见的判断场景,决定是否需要额外审核。
- 实验显示该方法显著降低不同群体间的判断差异,同时保持预测稳定。
- 无需修改模型参数,可解释的公平性指标适合实际在线内容审核系统。
大型语言模型(LLMs)越来越多地用于在线内容审核中的毒性评估,确保跨人群的公平性至关重要。然而,这些模型在处理隐含仇恨言论等细微表达时往往产生不一致的毒性判断,暴露出难以通过常规训练修正的内在偏差。现有方法常忽视一个关键问题:何时应触发纠正机制以确保评估的公平与可靠?为此,我们提出 FairToT,一种基于提示引导的推理时框架,用于提升 LLM 的公平性。FairToT 能识别可能出现群体相关差异的案例,并判断是否需要进一步评估。此外,我们引入两个可解释的公平性指标,检测此类情况并提升推理一致性,且无需修改模型参数。在基准数据集上的实验表明,FairToT 有效降低了群体层面的差异,同时维持了稳定可靠的毒性预测,证明推理时优化是提升基于 LLM 的毒性评估系统公平性的有效且实用路径。源代码见 https://aisuko.github.io/fair-tot/。
原文摘要 · Abstract (English)
Large Language Models (LLMs) are increasingly used for toxicity assessment in online moderation systems, where fairness across demographic groups is essential for equitable treatment. However, LLMs often produce inconsistent toxicity judgements for subtle expressions, particularly those involving implicit hate speech, revealing underlying biases that are difficult to correct through standard training. This raises a key question that existing approaches often overlook: when should corrective mechanisms be invoked to ensure fair and reliable assessments? To address this, we propose FairToT, an inference-time framework that enhances LLM fairness through prompt-guided toxicity assessment. FairToT identifies cases where demographic-related variation is likely to occur and determines when additional assessment should be applied. In addition, we introduce two interpretable fairness indicators that detect such cases and improve inference consistency without modifying model parameters. Experiments on benchmark datasets show that FairToT reduces group-level disparities while maintaining stable and reliable toxicity predictions, demonstrating that inference-time refinement offers an effective and practical approach for fairness improvement in LLM-based toxicity assessment systems. The source code can be found at https://aisuko.github.io/fair-tot/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。