提出SPIN方法,解决大模型公平性与隐私性相互冲突的问题。
The Tug of War Within: Mitigating the Fairness-Privacy Conflicts in Large Language Models
- 通过抑制耦合神经元,降低公平性与隐私性的互信息。
- 使Qwen-2-7B-Instruct的公平性和隐私性分别提升12.2%和14.0%。
- 无需标注数据,在恶意训练数据下仍有效,适合实际部署。
确保大型语言模型(LLMs)具备公平性与隐私意识至关重要。我们发现一个反直觉现象:通过监督微调(SFT)提升模型隐私意识后,其公平性意识显著下降,且在数千样本下表现明显。受信息论启发,我们提出一种无需训练的方法——抑制隐私与公平耦合神经元(SPIN),理论上并实证降低了公平性与隐私性之间的互信息。大量实验表明,SPIN消除了该权衡现象,显著同步提升模型公平性与隐私性,同时不损害通用能力。例如,使Qwen-2-7B-Instruct的公平性意识提升12.2%,隐私意识提升14.0%。更重要的是,即使仅有少量标注数据或仅存在恶意微调数据,SPIN仍保持鲁棒有效性,而SFT方法可能失效。此外,SPIN可推广至其他潜在权衡维度。本研究为协同应对大模型公平性与隐私性问题提供新思路,有助于构建更负责任的AI系统。代码已开源。
原文摘要 · Abstract (English)
Ensuring awareness of fairness and privacy in Large Language Models (LLMs) is critical. Interestingly, we discover a counter-intuitive trade-off phenomenon that enhancing an LLM's privacy awareness through Supervised Fine-Tuning (SFT) methods significantly decreases its fairness awareness with thousands of samples. To address this issue, inspired by the information theory, we introduce a training-free method to \textbf{S}uppress the \textbf{P}rivacy and fa\textbf{I}rness coupled \textbf{N}eurons (\textbf{SPIN}), which theoretically and empirically decrease the mutual information between fairness and privacy awareness. Extensive experimental results demonstrate that SPIN eliminates the trade-off phenomenon and significantly improves LLMs' fairness and privacy awareness simultaneously without compromising general capabilities, \eg improving Qwen-2-7B-Instruct's fairness awareness by 12.2\% and privacy awareness by 14.0\%. More crucially, SPIN remains robust and effective with limited annotated data or even when only malicious fine-tuning data is available, whereas SFT methods may fail to perform properly in such scenarios. Furthermore, we show that SPIN could generalize to other potential trade-off dimensions. We hope this study provides valuable insights into concurrently addressing fairness and privacy concerns in LLMs and can be integrated into comprehensive frameworks to develop more ethical and responsible AI systems. Our code is available at https://github.com/ChnQ/SPIN.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。