从单图生成可动3D车模型,支持关节与铰链精准建模
Part-Level 3D Gaussian Vehicle Generation with Joint and Hinge Axis Estimation

- 通过高斯表示与部件边界优化,实现零件级精细建模
- 能准确预测车轮、车门等部件的旋转轴和运动关节位置
- 适合自动驾驶仿真中需要动态车辆的场景
自动驾驶仿真依赖真实车辆建模,但现有方法多将车辆视为刚体,难以体现部件级运动。当前基于CAD的流程受限于模板库覆盖范围,无法还原真实场景中的车辆实例。本文提出一种生成框架,仅需单张图像或稀疏多视角输入,即可合成可动画化的3D高斯车辆模型。针对两大挑战:(i)大型3D生成器优化静态质量却忽略可动性,导致动画时部件边界出现形变;(ii)仅靠分割无法获取运动所需的运动学参数。为此,我们设计部件边缘精修模块,强制每个高斯点归属唯一部件;并引入运动学推理头,直接预测可动部件的关节位置与铰链轴。二者结合,实现了对部件级运动的真实模拟,填补了静态生成与可动画模型之间的空白。
原文摘要 · Abstract (English)
Simulation is essential for autonomous driving, yet current frameworks often model vehicles as rigid assets and fail to capture part-level articulation. With perception algorithms increasingly leveraging dynamics such as wheel steering or door opening, realistic simulation requires animatable vehicle representations. Existing CAD-based pipelines are limited by library coverage and fixed templates, preventing faithful reconstruction of in-the-wild instances. We propose a generative framework that, from a single image or sparse multi-view input, synthesizes an animatable 3D Gaussian vehicle. Our method addresses two challenges: (i) large 3D asset generators are optimized for static quality but not articulation, leading to distortions at part boundaries when animated; and (ii) segmentation alone cannot provide the kinematic parameters required for motion. To overcome this, we introduce a part-edge refinement module that enforces exclusive Gaussian ownership and a kinematic reasoning head that predicts joint positions and hinge axes of movable parts. Together, these components enable faithful part-aware simulation, bridging the gap between static generation and animatable vehicle models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。