用扩散模型生成既美观又扫码稳定的艺术二维码
DiffQRCoder: Diffusion-based Aesthetic QR Code Generation with Scanning Robustness Guided Iterative Refinement
- 引入扫描鲁棒感知引导,确保生成过程兼顾真实二维码结构
- 在严苛条件下实现95%以上扫码成功率,较基线提升至99%
- 无需训练,适合对视觉美感与实用性都有要求的场景
随着扩散模型在图像生成中的成功,其也革新了美观二维码的生成技术。尽管美化后的二维码视觉吸引力显著提升,但通常牺牲了可扫描性,限制了实际应用。为此,我们提出一种无需训练的基于扩散模型的二维码生成方法(DiffQRCoder),可同时生成可扫描且美观的二维码。该方法引入扫描鲁棒感知引导(SRPG),在去噪过程中确保生成结果符合真实二维码结构的同时保持美学吸引力。此外,提出后处理技术——扫描鲁棒流形投影梯度下降(SR-MPGD),通过迭代隐空间优化进一步增强扫描鲁棒性。大量实验表明,该方法在扫码成功率(SSR)上优于对比方法,且美学评分(CLIP-aes.)相当或更优;尤其将仅使用ControlNet的方法的SSR从60%提升至99%。主观评估显示用户对生成结果的视觉美感认可度高。即使在不同扫描角度和最严格的纠错容忍设置下,仍能稳定保持超过95%的SSR,展现出强大的实际应用能力。
原文摘要 · Abstract (English)
With the success of Diffusion Models for image generation, the technologies also have revolutionized the aesthetic Quick Response (QR) code generation. Despite significant improvements in visual attractiveness for the beautified codes, their scannabilities are usually sacrificed and thus hinder their practical uses in real-world scenarios. To address this issue, we propose a novel training-free Diffusion-based QR Code generator (DiffQRCoder) to effectively craft both scannable and visually pleasing QR codes. The proposed approach introduces Scanning-Robust Perceptual Guidance (SRPG), a new diffusion guidance for Diffusion Models to guarantee the generated aesthetic codes to obey the ground-truth QR codes while maintaining their attractiveness during the denoising process. Additionally, we present another post-processing technique, Scanning Robust Manifold Projected Gradient Descent (SR-MPGD), to further enhance their scanning robustness through iterative latent space optimization. With extensive experiments, the results demonstrate that our approach not only outperforms other compared methods in Scanning Success Rate (SSR) with better or comparable CLIP aesthetic score (CLIP-aes.) but also significantly improves the SSR of the ControlNet-only approach from 60% to 99%. The subjective evaluation indicates that our approach achieves promising visual attractiveness to users as well. Finally, even with different scanning angles and the most rigorous error tolerance settings, our approach robustly achieves over 95% SSR, demonstrating its capability for real-world applications. Our project page is available at https://jwliao1209.github.io/DiffQRCoder.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。