通过截断微调更新的奇异值尾部,不重新训练就能减少模型对少数群体的偏见。
Shortcuts in the Tail: Debiasing via Post-Hoc Spectral Compression of Fine-Tuning Updates

- 截断微调参数变化矩阵ΔW的奇异值尾部,抑制模型对虚假关联的依赖。
- 在多个模型和数据集上,偏见差距降低最多5倍,准确率损失小于2个百分点。
- 无需重新训练或分组标签,适合快速修复现有模型的公平性问题。
微调常会引入与任务无关的虚假相关性,导致对少数群体的表现系统性下降。现有缓解方法需重训练、分组标签或人工构造反事实数据。本文提出一种无需这些条件的后处理干预:对微调更新ΔW = W_ft - W_base进行奇异值分解(SVD),截断其尾部成分,可显著降低虚假关联带来的群体差距,同时保持任务准确率。在三个指令微调模型(0.5B–7B)和四个分类基准上,顶-k截断在所有测试条件下均有效,最大减少5倍偏差,准确率损失低于2个百分点(如在CivilComments上)。我们发现,虚假响应位于ΔW奇异值排序的尾部,而非原始奇异值分布本身;控制实验表明,低秩近似或秩约束训练无法解释该效果。这提示ΔW的奇异基可能是一个揭示微调学习内容的有效坐标系。
原文摘要 · Abstract (English)
Fine-tuning often introduces spurious correlations alongside task knowledge, causing systematic failures on underrepresented groups. Existing mitigations require retraining, group labels, or curated counterfactual data. We show a simple post-hoc intervention reduces shortcut reliance without any of these: truncating the tail of the SVD of $ΔW = W_\mathrm{ft} - W_\mathrm{base}$ reduces the spurious-group gap while preserving task accuracy. Across three instruction-tuned models ($0.5$B--$7$B) and four classification benchmarks, top-$k$ truncation reduces the gap on every cell at $<2$ pp accuracy loss, by up to $5\times$ on CivilComments. We propose this works because the shortcut response sits in the tail of the singular ordering of $ΔW$, a claim about how truncation behaves rather than about the raw singular values, which are broadly distributed and look the same across all four datasets. A controlled boundary case in which fine-tuning has only a shortcut to learn shows the predicted FT-to-base collapse, and bottom-/random-$k$ and matched-rank LoRA controls rule out generic low-rank approximation and rank-constrained training as the explanation. We read this as preliminary evidence that the singular basis of $ΔW$ is a useful coordinate system for studying what fine-tuning has learned.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。