用生物力学模型生成脊柱3D关键点,构建首个公开自然动作脊柱数据集。
SIMSPINE: A Biomechanics-Aware Simulation Framework for 3D Spine Motion Annotation and Benchmarking
- 基于肌肉骨骼模型生成符合解剖结构的脊柱3D关键点
- 构建214万帧的SIMSPINE数据集,支持自然动作分析
- 提供预训练模型,推动视觉脊柱运动估计研究
脊柱运动建模是理解人体生物力学的基础,但因脊柱多关节运动复杂且缺乏大规模3D标注,在计算机视觉中仍研究不足。本文提出一种生物力学感知的关键点模拟框架,利用肌肉骨骼模型生成解剖一致的3D脊柱关键点,扩充现有姿态数据集。基于此框架,创建首个公开数据集SIMSPINE,提供在室内多相机采集、无外部约束条件下自然全身动作的稀疏椎体级3D脊柱标注。该数据集包含214万帧,支持从细微姿态变化中学习椎体运动规律,并弥合肌肉骨骼仿真与计算机视觉之间的差距。同时发布预训练基线,涵盖微调后的2D检测器、单目3D姿态提升模型及多视角重建流程,建立统一的生物力学有效脊柱运动估计基准。具体而言,2D脊柱基线在受控环境中将AUC从0.63提升至0.80,在野外追踪任务中将AP从0.91提升至0.93。整体框架与数据集推动基于视觉的生物力学、运动分析与数字人建模研究,实现自然条件下可复现的解剖学基础3D脊柱估计。
原文摘要 · Abstract (English)
Modeling spinal motion is fundamental to understanding human biomechanics, yet remains underexplored in computer vision due to the spine's complex multi-joint kinematics and the lack of large-scale 3D annotations. We present a biomechanics-aware keypoint simulation framework that augments existing human pose datasets with anatomically consistent 3D spinal keypoints derived from musculoskeletal modeling. Using this framework, we create the first open dataset, named SIMSPINE, which provides sparse vertebra-level 3D spinal annotations for natural full-body motions in indoor multi-camera capture without external restraints. With 2.14 million frames, this enables data-driven learning of vertebral kinematics from subtle posture variations and bridges the gap between musculoskeletal simulation and computer vision. In addition, we release pretrained baselines covering fine-tuned 2D detectors, monocular 3D pose lifting models, and multi-view reconstruction pipelines, establishing a unified benchmark for biomechanically valid spine motion estimation. Specifically, our 2D spine baselines improve the state-of-the-art from 0.63 to 0.80 AUC in controlled environments, and from 0.91 to 0.93 AP for in-the-wild spine tracking. Together, the simulation framework and SIMSPINE dataset advance research in vision-based biomechanics, motion analysis, and digital human modeling by enabling reproducible, anatomically grounded 3D spine estimation under natural conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。