通过删减内部偏见参数和加选项,让大模型选答案更公平。
Mitigating Selection Bias with Node Pruning and Auxiliary Options
- 删掉导致偏见的神经元参数,直接从模型内部改
- 加一个干扰选项,白盒黑盒都有效,准确率提10%以上
- 新指标能看清选错分布,适合评估模型公平性
大型语言模型在回答多选题时常表现出对某些选项的系统性偏好,即选择偏差,这降低了输出的准确性和可靠性,限制了其在关键决策场景中的应用。现有方法主要通过调整输入或输出来缓解该问题,而本文提出全新思路:识别并移除模型内部的偏见来源。我们提出两种方法:偏差节点剪枝(BNP),通过剪除贡献于选择偏差的参数来修正模型;辅助选项注入(AOI),引入额外答案选项,在白盒与黑盒设置下均能降低偏差。为解决现有评估指标的不足,我们提出选择KL散度(CKLD),用于捕捉模型预测分布的不平衡性。在三个大模型、多个数据集上的实验表明,所提方法显著提升答题准确率并减少选择偏差,对开源与闭源模型均具鲁棒性。
原文摘要 · Abstract (English)
Large language models (LLMs) often exhibit systematic preferences for certain answer choices when responding to multiple-choice questions-a behavior known as selection bias. This bias reduces the accuracy and reliability of LLM outputs, limiting their usefulness in decision-critical applications. While prior work has focused on adjusting model inputs or outputs to mitigate this issue, our work takes a fundamentally different approach by identifying and removing the internal sources of bias. We introduce two methods: Bias Node Pruning (BNP), which prunes parameters that contribute to selection bias, and Auxiliary Option Injection (AOI), which introduces an additional answer choice to reduce bias in both white-box and black-box settings. To address the shortcomings of existing evaluation metrics, we propose Choice Kullback-Leibler Divergence (CKLD), a new metric that captures distributional imbalances in model predictions. Experiments on three LLMs across multiple datasets demonstrate that our methods consistently improve answer accuracy while reducing selection bias, providing a robust solution for both open- and closed-source models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。