arXiv:2409.19322cs.CVcs.AI2024-09被引 2

用手机拍2D图,自动生成可编辑的3D模型,适合工业级数字孪生应用。

Scalable Cloud-Native Pipeline for Efficient 3D Model Reconstruction from Monocular Smartphone Images

  • 基于云端微服务架构,整合NVIDIA与Google ARCore技术,实现端到端3D重建。
  • 支持单目手机图像输入,输出带材质纹理的可导出3D模型,精度满足工业需求。
  • 模块化设计便于部署,适合制造业、培训等需快速构建数字孪生的场景。

近年来,3D模型在娱乐、制造和仿真等领域广泛应用。但人工建模耗时费力,难以满足大规模工业应用需求。为此,研究人员利用人工智能与机器学习算法实现自动化3D建模。本文提出一种新型云原生流水线,可从智能手机拍摄的单目2D图像中自动重建3D模型。目标是提供符合工业4.0标准的高效、易部署解决方案,用于构建数字孪生模型,以加速人员培训与技能提升。系统融合NVIDIA Research Labs的机器学习模型,并集成基于Google ARCore框架的自定义姿态记录器及独特的姿态补偿组件。最终输出的3D模型包含可复用的材质与纹理,支持导出至任意外部3D建模软件或引擎。整个流程采用微服务架构,使各模块可独立运行、替换,具备高度可扩展性。

原文摘要 · Abstract (English)

In recent years, 3D models have gained popularity in various fields, including entertainment, manufacturing, and simulation. However, manually creating these models can be a time-consuming and resource-intensive process, making it impractical for large-scale industrial applications. To address this issue, researchers are exploiting Artificial Intelligence and Machine Learning algorithms to automatically generate 3D models effortlessly. In this paper, we present a novel cloud-native pipeline that can automatically reconstruct 3D models from monocular 2D images captured using a smartphone camera. Our goal is to provide an efficient and easily-adoptable solution that meets the Industry 4.0 standards for creating a Digital Twin model, which could enhance personnel expertise through accelerated training. We leverage machine learning models developed by NVIDIA Research Labs alongside a custom-designed pose recorder with a unique pose compensation component based on the ARCore framework by Google. Our solution produces a reusable 3D model, with embedded materials and textures, exportable and customizable in any external 3D modelling software or 3D engine. Furthermore, the whole workflow is implemented by adopting the microservices architecture standard, enabling each component of the pipeline to operate as a standalone replaceable module.

3D重建数字孪生云原生手机建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。