为脉冲神经网络设计了基于膜电位的水印,防替换输出头窃取版权。
MeMark: Membrane-Space Watermarking for Spiking Neural Networks

- 将水印嵌入选定脉冲神经元的膜电位状态中,无需解码器验证。
- 20个64位密钥在2154万参数模型上全通过验证,随机密钥无一通过。
- 对微调、剪枝、量化和头部替换均保持有效,适合保护预训练模型版权。
脉冲神经网络(SNNs)越来越多以预训练检查点形式分发并用作新任务的骨干网络。然而,现有SNN水印主要依赖模型输出验证,攻击者可替换输出头保留大部分原网络并移除验证证据。我们提出MeMark,一种专为检查点重用场景设计的水印方案。不将水印存于输出头,而是将多比特标识嵌入选定的漏电积分放电(LIF)神经元内部膜电位中。秘密输入驱动选定神经元至其放电阈值一侧,后续用同一阈值恢复密文比特,验证方无需学习解码器。我们在循环、卷积、残差及变换器SNN上评估MeMark。在215.4M参数的SpikeGPT检查点上,所有20个独立64位密钥均通过固定51/64验证规则,而30,000个随机密钥在所有20个受保护检查点及干净模型上均未通过。所有20个真实密钥在微调、90%剪枝、int8量化和输出头替换后仍高于阈值。在我们设定的威胁模型下,自适应攻击虽可削弱水印,但无法清除所有权证据。我们还研究了错误归属、密钥感知与非感知删除、部分密钥泄露、回滚及提取至学生模型等问题。结果表明,MeMark能提供检查点衍生品的证据,且对攻击和完整头部替换具有鲁棒性。
原文摘要 · Abstract (English)
Spiking Neural Networks (SNNs) are increasingly distributed as pretrained checkpoints and reused as backbones for new tasks. However, current SNN watermarks are mainly verified against the model output. Thus, a user who replaces the output head can keep most of the original network while removing the evidence used for verification. We present MeMark, a watermark designed for the checkpoint-reuse setting. Instead of storing the watermark in the output head, MeMark embeds a multi-bit identifier in the internal membrane state of selected Leaky Integrate-and-Fire (LIF) neurons. A secret input drives each selected neuron to the chosen side of its own firing threshold, and the same threshold is later used to recover the secret bit, so the verifier does not need a learned decoder. We evaluate MeMark across recurrent, convolutional, residual, and transformer SNNs. On a 215.4M-parameter SpikeGPT checkpoint, all 20 independent 64-bit keys pass the fixed 51/64 verification rule, while none of the $30\,000$ fresh random keys pass when tested against all 20 protected checkpoints and the clean model. All 20 genuine keys also remain above the threshold after fine-tuning, 90\% pruning, int8 quantization, and output-head replacement. Under our stated threat model, adaptive attacks can weaken the watermark but do not remove the ownership evidence in the settings we test. Additionally, we study false ownership claims, key-aware and key-agnostic removal, partial key disclosure, rollback, and extraction into a student. The results show that MeMark can provide evidence of checkpoint derivatives, while being resistant to the adversary's attacks and complete head replacement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。