arXiv:2607.26723cs.CRcs.AI2026-07中稿 · ICLR

提出快速逆向方法FARI,让扩散模型水印更高效且抗干扰。

FARI: Robust One-Step Inversion for Watermarking in Diffusion Models

论文配图:FARI: Robust One-Step Inversion for Watermarking in Diffusion Models
图 1 · 摘自论文原文
  • 采用单步逆向+轻量级对抗微调,大幅降低推理时间。
  • 在20分钟微调后,1步逆向效果超过50步DDIM,鲁棒性更强。
  • 适合需要快速验证水印真实性的应用,如内容安全审核。

基于逆向的水印认证是鉴别扩散生成图像的有效方法,但实际应用受限于逆向过程慢且易出错。现有方法过度优化内部截断误差,而该误差随采样步数增大,导致只能在高函数评估次数(NFE)下运行,难以兼顾速度与鲁棒性。本文发现:(i) 逆向轨迹曲率显著低于正向生成路径,可高度压缩,适合低NFE近似;(ii) 在水印验证中,外部失真主导误差,速度与截断误差的权衡不那么关键。更快的逆向不仅提升效率,还支持端到端对抗训练直接优化鲁棒性,这对原始长逆向路径来说计算成本过高。为此,我们提出FARI(Fast Asymmetric Robust Inversion),结合单步逆向与轻量级对抗LoRA微调的去噪器进行水印提取。尽管内部误差略有上升,但FARI在速度和鲁棒性上均有显著提升:仅需单张NVIDIA RTX A6000 GPU上约20分钟微调,其性能即超越50步DDIM逆向,在水印验证中表现更优。代码与预训练模型已开源。

原文摘要 · Abstract (English)

Inversion-based watermarking is a promising approach to authenticate diffusion-generated images, yet practical use is bottlenecked by inversion that is both slow and error-prone. While the primary challenge in the watermarking setting is robustness against external distortions, existing approaches over-optimize internal truncation error, and because that error scales with the sampler step size, they are inherently confined to high-NFE (number of function evaluations) regimes that cannot meet the dual demands of speed and robustness. In this work, we have two key observations: (i) the inversion trajectory has markedly lower curvature than the forward generation path does, making it highly compressible and amenable to low-NFE approximation; and (ii) in inversion for watermark verification, the trade-off between speed and truncation error is less critical, since external distortions dominate the error. A faster inverter provides a dual benefit: it is not only more efficient, but it also enables end-to-end adversarial training to directly target robustness, a task that is computationally prohibitive for the original, lengthy inversion trajectories. Building on this, we propose \textbf{FARI} (\textbf{F}ast \textbf{A}symmetric \textbf{R}obust \textbf{I}nversion), a one-step inversion framework paired with lightweight adversarial LoRA fine-tuning of the denoiser for watermark extraction. While consolidation slightly increases internal error, FARI delivers large gains in both speed and robustness: with approximately 20 minutes of fine-tuning on a single NVIDIA RTX A6000 GPU, it surpasses 50-step DDIM inversion on watermark-verification robustness while dramatically reducing inference time. Code and pretrained models are available at https://github.com/0xD009/FARI.

水印扩散模型逆向生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。