高保真可交互3D物体数据集,助力机器人仿真训练
ArtVIP: Articulated Digital Assets of Visual Realism, Modular Interaction, and Physical Fidelity for Robot Learning
- 构建高精度数字孪生物体,统一标准保证视觉与物理真实
- 内置模块化交互行为与像素级功能标注,支持复杂任务学习
- 开源可用,适用于模仿学习与强化学习,适合机器人研究者
机器人学习依赖仿真提升复杂技能,如灵巧操作和精准交互,亟需高质量数字资产缩小仿真到现实的差距。现有开源关节物体数据集受限于视觉真实度不足与物理保真度低,难以支撑真实世界任务的模型训练。为此,我们提出ArtVIP,一个全面开源的数据集,包含高保真数字孪生关节物体及室内场景资产。由专业3D建模师按统一标准制作,通过精确几何网格与高分辨率贴图保障视觉真实,通过精细调校的动力学参数实现物理保真。数据集首次在资产中嵌入模块化交互行为与像素级功能标注。采用特征图可视化与光学动捕技术定量验证其视觉与物理保真度,并在模仿学习与强化学习实验中验证其适用性。数据以USD格式提供,附详细制作指南,完全开源,惠及研究社区,推动机器人学习发展。项目地址:https://x-humanoid-artvip.github.io/
原文摘要 · Abstract (English)
Robot learning increasingly relies on simulation to advance complex ability such as dexterous manipulations and precise interactions, necessitating high-quality digital assets to bridge the sim-to-real gap. However, existing open-source articulated-object datasets for simulation are limited by insufficient visual realism and low physical fidelity, which hinder their utility for training models mastering robotic tasks in real world. To address these challenges, we introduce ArtVIP, a comprehensive open-source dataset comprising high-quality digital-twin articulated objects, accompanied by indoor-scene assets. Crafted by professional 3D modelers adhering to unified standards, ArtVIP ensures visual realism through precise geometric meshes and high-resolution textures, while physical fidelity is achieved via fine-tuned dynamic parameters. Meanwhile, the dataset pioneers embedded modular interaction behaviors within assets and pixel-level affordance annotations. Feature-map visualization and optical motion capture are employed to quantitatively demonstrate ArtVIP's visual and physical fidelity, with its applicability validated across imitation learning and reinforcement learning experiments. Provided in USD format with detailed production guidelines, ArtVIP is fully open-source, benefiting the research community and advancing robot learning research. Our project is at https://x-humanoid-artvip.github.io/ .
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。