arXiv:2512.02689cs.CLcs.AI2025-12中稿 · PACLIC 2025综述

对比七种模型融合方法,发现部分能有效降偏且不损性能。

An Empirical Survey of Model Merging Algorithms for Social Bias Mitigation

  • 采用七种模型融合算法,对多个大模型进行社会偏见修正。
  • 线性、SLERP、Nearswap在降偏同时保持较好下游任务表现。
  • 过度去偏或选错方法会损害阅读理解等关键语言能力。

大型语言模型(LLMs)常继承甚至放大预训练语料中的社会偏见,威胁公平与社会信任。为应对这一问题,近期研究尝试通过模型融合方法调整参数以缓解社会偏见,但缺乏实证比较。本文系统评估了七种算法:Linear、Karcher Mean、SLERP、NuSLERP、TIES、DELLA 和 Nearswap,使用13个来自GPT、LLaMA和Qwen系列的开源模型,在三个偏见数据集(BBQ、BOLD、HONEST)上进行评估,并测试其对SuperGLUE基准下游任务性能的影响。结果表明,偏见缓解与下游性能之间存在权衡:实现更强去偏效果的方法会降低准确率,尤其在需要阅读理解、常识与因果推理的任务中表现更差。其中,Linear、SLERP 和 Nearswap 在持续降低偏见的同时维持整体性能,而 SLERP 在中等插值权重下表现最为平衡。研究揭示模型融合在去偏中的潜力,也警示过度去偏或不当融合可能损害重要语言能力。

原文摘要 · Abstract (English)

Large language models (LLMs) are known to inherit and even amplify societal biases present in their pre-training corpora, threatening fairness and social trust. To address this issue, recent work has explored ``editing'' LLM parameters to mitigate social bias with model merging approaches; however, there is no empirical comparison. In this work, we empirically survey seven algorithms: Linear, Karcher Mean, SLERP, NuSLERP, TIES, DELLA, and Nearswap, applying 13 open weight models in the GPT, LLaMA, and Qwen families. We perform a comprehensive evaluation using three bias datasets (BBQ, BOLD, and HONEST) and measure the impact of these techniques on LLM performance in downstream tasks of the SuperGLUE benchmark. We find a trade-off between bias reduction and downstream performance: methods achieving greater bias mitigation degrade accuracy, particularly on tasks requiring reading comprehension and commonsense and causal reasoning. Among the merging algorithms, Linear, SLERP, and Nearswap consistently reduce bias while maintaining overall performance, with SLERP at moderate interpolation weights emerging as the most balanced choice. These results highlight the potential of model merging algorithms for bias mitigation, while indicating that excessive debiasing or inappropriate merging methods may lead to the degradation of important linguistic abilities.

模型融合社会偏见去偏实证分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。