arXiv:2512.16199cs.CV2025-12被引 1

Avatar4D生成可定制的4D人体数据,助力体育动作识别。

Avatar4D: Synthesizing Domain-Specific 4D Humans for Real-World Pose Estimation

  • 通过控制姿态、外观、视角和环境,自动生成高保真4D人体序列。
  • 在棒球与冰球数据集上验证,模型在真实数据上实现零样本迁移。
  • 适合需要特定领域人体数据的体育、医疗等场景使用。

我们提出Avatar4D,一个可迁移的合成人体运动数据生成管道,专为特定应用领域设计。与以往关注日常动作且灵活性有限的方法不同,本方法可在无需人工标注的情况下,精细控制身体姿态、外观、相机视角和环境背景。为验证其效果,我们聚焦体育领域,引入大型合成数据集Syn2Sport,涵盖棒球与冰球等项目。Avatar4D生成具有高保真度的4D(时空3D几何)人体运动序列,人物外观多样,渲染于多种环境。我们在Syn2Sport上测试多个先进姿态估计模型,证明其在监督学习、零样本迁移到真实数据及跨运动泛化方面的有效性。此外,评估了合成数据与真实数据在特征空间中的对齐程度。结果表明,该系统能高效生成可扩展、可控制且可迁移的人体数据,适用于多样化领域任务,且无需依赖特定领域的实拍数据。

原文摘要 · Abstract (English)

We present Avatar4D, a real-world transferable pipeline for generating customizable synthetic human motion datasets tailored to domain-specific applications. Unlike prior works, which focus on general, everyday motions and offer limited flexibility, our approach provides fine-grained control over body pose, appearance, camera viewpoint, and environmental context, without requiring any manual annotations. To validate the impact of Avatar4D, we focus on sports, where domain-specific human actions and movement patterns pose unique challenges for motion understanding. In this setting, we introduce Syn2Sport, a large-scale synthetic dataset spanning sports, including baseball and ice hockey. Avatar4D features high-fidelity 4D (3D geometry over time) human motion sequences with varying player appearances rendered in diverse environments. We benchmark several state-of-the-art pose estimation models on Syn2Sport and demonstrate their effectiveness for supervised learning, zero-shot transfer to real-world data, and generalization across sports. Furthermore, we evaluate how closely the generated synthetic data aligns with real-world datasets in feature space. Our results highlight the potential of such systems to generate scalable, controllable, and transferable human datasets for diverse domain-specific tasks without relying on domain-specific real data.

4D人体合成数据姿态估计体育分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。