提出MixBridge框架,实现扩散模型中多种异构后门触发器的混合植入。
MixBridge: Heterogeneous Image-to-Image Backdoor Attack through Mixture of Schrödinger Bridges
- 基于薛定谔桥框架,支持任意输入分布的图像到图像生成任务。
- 通过中毒图像对直接训练,无需修改随机微分方程即可注入多个后门。
- 采用分治合并策略与权重重分配方案,提升后门隐蔽性与多任务兼容性。
本文聚焦于在面向复杂任意输入分布的桥接型扩散模型中植入多个异构后门触发器。现有后门方法主要针对单一攻击场景,且局限于高斯噪声输入模型。为填补此空白,我们提出MixBridge,一种新型扩散薛定谔桥(DSB)框架,可适配任意输入分布(图像到图像任务为特例)。此外,我们证明可通过直接使用中毒图像对进行训练,将后门触发器注入MixBridge,无需像以往研究那样繁琐地修改随机微分方程,从而提供灵活工具以研究桥接模型的后门行为。然而,一个关键问题是:单个DSB模型能否同时训练多个后门触发器?理论分析表明,当尝试此操作时,模型会趋向于良性和被污染分布的几何均值,导致各后门任务间性能冲突。为此,我们提出分治-合并策略:先独立预训练各目标模型(分治),再整合为统一模型(合并)。同时设计了权重重分配方案(WRS)以增强混合作用下的隐蔽性。在多种生成任务上的实证研究验证了MixBridge的有效性。
原文摘要 · Abstract (English)
This paper focuses on implanting multiple heterogeneous backdoor triggers in bridge-based diffusion models designed for complex and arbitrary input distributions. Existing backdoor formulations mainly address single-attack scenarios and are limited to Gaussian noise input models. To fill this gap, we propose MixBridge, a novel diffusion Schrödinger bridge (DSB) framework to cater to arbitrary input distributions (taking I2I tasks as special cases). Beyond this trait, we demonstrate that backdoor triggers can be injected into MixBridge by directly training with poisoned image pairs. This eliminates the need for the cumbersome modifications to stochastic differential equations required in previous studies, providing a flexible tool to study backdoor behavior for bridge models. However, a key question arises: can a single DSB model train multiple backdoor triggers? Unfortunately, our theory shows that when attempting this, the model ends up following the geometric mean of benign and backdoored distributions, leading to performance conflict across backdoor tasks. To overcome this, we propose a Divide-and-Merge strategy to mix different bridges, where models are independently pre-trained for each specific objective (Divide) and then integrated into a unified model (Merge). In addition, a Weight Reallocation Scheme (WRS) is also designed to enhance the stealthiness of MixBridge. Empirical studies across diverse generation tasks speak to the efficacy of MixBridge.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。