无需标注数据,一键还原游戏角色3D面部细节。
Unsupervised Cross-Domain Regression for Fine-grained 3D Game Character Reconstruction
- 设计跨域回归框架,减少真实与游戏图像的差异。
- 在无真值条件下实现高保真3D角色重建,参数生成精准。
- 适合游戏开发、虚拟人制作等需要快速建模的场景。
随着元宇宙和游戏的快速发展,虚拟世界中角色的精准重建愈发重要。沉浸式体验是元宇宙的核心,而角色形象的可编辑性至关重要。本文提出一种简单但强大的端到端跨域框架,仅需单张图像即可重建精细的3D游戏角色。不同于以往方法忽略跨域差异的问题,我们设计了一个有效回归器,显著降低真实世界与游戏域之间的差距。针对缺乏真值的挑战,提出的无监督框架实现了目标域的知识迁移。创新地引入对比损失,解决个体差异问题,保留人物特有细节;同时启用辅助3D身份感知提取器,使结果更完善。最终稳健且精致地生成大量具有物理意义的面部参数。实验表明,该方法在3D游戏角色重建任务上达到当前最优性能。
原文摘要 · Abstract (English)
With the rise of the ``metaverse'' and the rapid development of games, it has become more and more critical to reconstruct characters in the virtual world faithfully. The immersive experience is one of the most central themes of the ``metaverse'', while the reducibility of the avatar is the crucial point. Meanwhile, the game is the carrier of the metaverse, in which players can freely edit the facial appearance of the game character. In this paper, we propose a simple but powerful cross-domain framework that can reconstruct fine-grained 3D game characters from single-view images in an end-to-end manner. Different from the previous methods, which do not resolve the cross-domain gap, we propose an effective regressor that can greatly reduce the discrepancy between the real-world domain and the game domain. To figure out the drawbacks of no ground truth, our unsupervised framework has accomplished the knowledge transfer of the target domain. Additionally, an innovative contrastive loss is proposed to solve the instance-wise disparity, which keeps the person-specific details of the reconstructed character. In contrast, an auxiliary 3D identity-aware extractor is activated to make the results of our model more impeccable. Then a large set of physically meaningful facial parameters is generated robustly and exquisitely. Experiments demonstrate that our method yields state-of-the-art performance in 3D game character reconstruction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。