提出新型对抗攻击框架,暴露数字人生成模型安全漏洞
Unveiling Hidden Vulnerabilities in Digital Human Generation via Adversarial Attacks
- 设计双异构噪声生成器,结合VAE与ControlNet生成精准干扰
- 攻击使姿态估计误差提升41.0%,平均提升17.0%
- 适用于评估数字人系统安全性,警示防御短板
表情化人体姿态与形态估计(EHPS)对数字人生成至关重要,尤其在直播等场景中。现有研究多关注降低估计误差,却忽视鲁棒性与安全性,导致系统易受对抗攻击。为此,我们提出 extbf{Tangible Attack (TBA)} 框架,可生成有效破坏任意数字人生成模型的对抗样本。该方法引入 extbf{双异构噪声生成器 (DHNG)},利用变分自编码器(VAE)与ControlNet生成针对原图特征的多样化、定向噪声。同时设计定制化的 extbf{对抗损失函数},优化噪声以实现高可控性与强破坏力。通过迭代融合噪声与先进EHPS模型的多梯度信号,TBA 显著提升攻击效果。大量实验表明,其使估计误差提升41.0\%,平均提升约17.0\"。这些结果揭示当前EHPS模型存在显著安全隐患,亟需加强数字人生成系统的防御能力。
原文摘要 · Abstract (English)
Expressive human pose and shape estimation (EHPS) is crucial for digital human generation, especially in applications like live streaming. While existing research primarily focuses on reducing estimation errors, it largely neglects robustness and security aspects, leaving these systems vulnerable to adversarial attacks. To address this significant challenge, we propose the \textbf{Tangible Attack (TBA)}, a novel framework designed to generate adversarial examples capable of effectively compromising any digital human generation model. Our approach introduces a \textbf{Dual Heterogeneous Noise Generator (DHNG)}, which leverages Variational Autoencoders (VAE) and ControlNet to produce diverse, targeted noise tailored to the original image features. Additionally, we design a custom \textbf{adversarial loss function} to optimize the noise, ensuring both high controllability and potent disruption. By iteratively refining the adversarial sample through multi-gradient signals from both the noise and the state-of-the-art EHPS model, TBA substantially improves the effectiveness of adversarial attacks. Extensive experiments demonstrate TBA's superiority, achieving a remarkable 41.0\% increase in estimation error, with an average improvement of approximately 17.0\%. These findings expose significant security vulnerabilities in current EHPS models and highlight the need for stronger defenses in digital human generation systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。