arXiv:2511.12977cs.CV2025-11被引 4

用大模型自动把静态3D物体转成可动的机器人可用模型

ArtiWorld: LLM-Driven Articulation of 3D Objects in Scenes

  • 基于文本描述和点云,用大模型识别可活动物体并生成URDF模型
  • 在三种场景下均超越现有方法,保持原形且正确还原互动关系
  • 适合需要快速构建机器人交互环境的研究者和开发者

构建交互式模拟器和可扩展机器人学习环境需要大量可动资产。但现有大部分3D资产为刚性,手动转换为可动物体成本极高。本文提出ArtiWorld,一种场景感知的流水线,通过文本场景描述定位候选可动物体,并重建保留原始几何形状的可执行URDF模型。核心是Arti4URDF,利用3D点云、大语言模型先验知识及面向URDF的提示设计,快速将刚性物体转为基于URDF的可动模型。在3D模拟物体、完整3D场景及真实扫描场景三类测试中,该方法持续优于现有方案,达到当前最优性能,同时保持物体几何形状并准确捕捉互动关系,生成可用的URDF可动模型。这为从现有3D资产直接构建机器人就绪的交互式模拟环境提供了实用路径。代码与数据将公开。

原文摘要 · Abstract (English)

Building interactive simulators and scalable robot-learning environments requires a large number of articulated assets. However, most existing 3D assets in simulation are rigid, and manually converting them into articulated objects is extremely labor- and cost-intensive. This raises a natural question: can we automatically identify articulable objects in a scene and convert them into articulated assets directly? In this paper, we present ArtiWorld, a scene-aware pipeline that localizes candidate articulable objects from textual scene descriptions and reconstructs executable URDF models that preserve the original geometry. At the core of this pipeline is Arti4URDF, which leverages 3D point cloud, prior knowledge of a large language model (LLM), and a URDF-oriented prompt design to rapidly convert rigid objects into interactive URDF-based articulated objects while maintaining their 3D shape. We evaluate ArtiWorld at three levels: 3D simulated objects, full 3D simulated scenes, and real-world scan scenes. Across all three settings, our method consistently outperforms existing approaches and achieves state-of-the-art performance, while preserving object geometry and correctly capturing object interactivity to produce usable URDF-based articulated models. This provides a practical path toward building interactive, robot-ready simulation environments directly from existing 3D assets. Code and data will be released.

3D建模机器人仿真LLM应用URDF生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。