arXiv:2508.13300cs.CVcs.AI2025-08ICCV

用扩散模型生成逼真步态,还能保护隐私并控制服装视角。

GaitCrafter: Diffusion Model for Biometric Preserving Gait Synthesis

  • 基于步态轮廓数据训练扩散模型,从零开始生成连续步态序列。
  • 合成数据提升识别性能,尤其在困难条件下效果显著。
  • 可生成新身份步态,保护真实个体隐私,适合隐私敏感场景。

步态识别是一种重要的远距离生物特征识别技术,依赖于个体行走姿态进行身份判断。然而,该任务受限于缺乏大规模标注数据集,且难以在保护隐私的前提下采集多样化步态样本。为此,我们提出 GaitCrafter,一种基于扩散模型的步态合成框架,专用于轮廓域中的真实步态序列生成。与以往依赖模拟环境或替代生成模型的方法不同,GaitCrafter 从头训练视频扩散模型,仅使用步态轮廓数据。该方法可生成时序一致且身份保留的步态序列,并支持对服装、携带物品、视角等协变量进行可控条件生成。实验表明,将 GaitCrafter 生成的合成样本引入步态识别流程,能显著提升模型性能,尤其在挑战性条件下。此外,我们提出一种通过插值身份嵌入生成新身份(原始数据中未出现的合成个体)的机制,这些新身份具有独特且一致的步态模式,适用于模型训练同时保护真实受试者隐私。本工作为高质量、可控、隐私友好的步态数据生成迈出了关键一步。

原文摘要 · Abstract (English)

Gait recognition is a valuable biometric task that enables the identification of individuals from a distance based on their walking patterns. However, it remains limited by the lack of large-scale labeled datasets and the difficulty of collecting diverse gait samples for each individual while preserving privacy. To address these challenges, we propose GaitCrafter, a diffusion-based framework for synthesizing realistic gait sequences in the silhouette domain. Unlike prior works that rely on simulated environments or alternative generative models, GaitCrafter trains a video diffusion model from scratch, exclusively on gait silhouette data. Our approach enables the generation of temporally consistent and identity-preserving gait sequences. Moreover, the generation process is controllable-allowing conditioning on various covariates such as clothing, carried objects, and view angle. We show that incorporating synthetic samples generated by GaitCrafter into the gait recognition pipeline leads to improved performance, especially under challenging conditions. Additionally, we introduce a mechanism to generate novel identities-synthetic individuals not present in the original dataset-by interpolating identity embeddings. These novel identities exhibit unique, consistent gait patterns and are useful for training models while maintaining privacy of real subjects. Overall, our work takes an important step toward leveraging diffusion models for high-quality, controllable, and privacy-aware gait data generation.

步态生成扩散模型隐私保护可控生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。