研究小模型微调中的隐私泄露问题,发现两种防护方法各有优劣。
Decomposing Memorization Reduction in Privacy-Preserving Fine-Tuning of SLMs for CSIRTs
- 用更新控制和哈希伪匿名化结合防护,减少记忆泄露
- 隐私保护下模型性能有限,F1仅0.19-0.28
- 适合关注安全合规的网络安全团队使用
CSIRTs越来越多地在漏洞扫描记录上微调语言模型,但这些数据暴露内部网络结构,在GDPR和LGPD等法规下带来隐私风险。本文首次对1B至3B参数的小语言模型在结构化CSIRT数据上微调时,DP SGD与HMAC伪匿名化的交互作用进行实证研究。评估了96个LoRA适配器,覆盖四个小模型和四种训练策略,包括原始微调、大批次QLoRA训练,以及epsilon为2和8的DP SGD。通过20个植入蜜罐、四种提取攻击及针对伪匿名标识的双重攻击进行记忆审计。结果显示:第一,匹配更新控制仅通过减少优化器更新次数,即可实现66%至132%的记忆减少(均值100%),而DP SGD虽提供形式化隐私保障,但未带来额外可测量的减少;第二,HMAC伪匿名化将原始标识从暴露面移除,降低暴露40%至61%,且伪匿名标识接近随机基线,未成为次级记忆目标;第三,所有96个适配器在四样本提示下F1得分维持在0.19至0.28之间,表明在当前训练预算下,1B至3B小模型未能达到实际可用性能。
原文摘要 · Abstract (English)
CSIRTs increasingly fine tune language models on vulnerability scan records, but these records expose internal network topology and create privacy risks under regulations such as GDPR and LGPD. We present the first empirical study of how DP SGD and HMAC pseudonymization interact when fine tuning small language models with 1B to 3B parameters on structured CSIRT data. We evaluate 96 LoRA adapters across four SLMs and four training regimes, including raw fine tuning, QLoRA with large batch training, and DP SGD with epsilon equal to 2 and 8. We also audit memorization using 20 planted canaries, four extraction attacks, and a dual attack targeting HMAC pseudonymized identifiers. Our results show three main findings. First, matched update controls reproduce the observed reduction in memorization by reducing the number of optimizer updates alone, accounting for 66 percent to 132 percent of the measured effect, with a mean of 100 percent across three seeds and four models. In this setting, DP SGD provides the formal privacy guarantee but does not produce additional measurable reductions in memorization. Second, HMAC pseudonymization removes the original identifiers from the exposure surface, reducing exposure by 40 percent to 61 percent, while pseudonymized identifiers remain close to the expected random baseline and do not become a secondary memorization target. Third, F1 scores remain between 0.19 and 0.28 across all 96 adapters using four shot prompting, indicating that, under the evaluated training budget, 1B to 3B SLMs do not achieve operationally useful performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。