用动态纹理生成逼真3D虚拟人，可直接用于游戏引擎
3D Engine-ready Photorealistic Avatars via Dynamic Textures
- 通过动态纹理增强低精度网格，实现真实感渲染
- 输出标准3D资产，兼容现有游戏渲染管线
- 适合想快速制作可集成虚拟人的开发者
随着数字世界与现实世界的融合加深，人们越来越关注能高度还原真实人物的数字虚拟人。当前3D生产流程中的数字化方法依赖昂贵的采集设备，难以普及至普通用户。近年来学术界利用隐式表示（如NeRF中的体素）从有限数据中重建人体，虽能生成逼真视频，但不兼容传统渲染管线，限制了在游戏等应用中的使用。本文提出一个端到端流程，基于标准3D资产构建显式表示的写实3D虚拟人。核心思想是使用动态生成的纹理提升真实感，并遮蔽底层网格几何的不足。该方法可在不改变现有图形管线的前提下，达到与顶尖3D虚拟人生成技术相当的视觉质量。
原文摘要 · Abstract (English)
As the digital and physical worlds become more intertwined, there has been a lot of interest in digital avatars that closely resemble their real-world counterparts. Current digitization methods used in 3D production pipelines require costly capture setups, making them impractical for mass usage among common consumers. Recent academic literature has found success in reconstructing humans from limited data using implicit representations (e.g., voxels used in NeRFs), which are able to produce impressive videos. However, these methods are incompatible with traditional rendering pipelines, making it difficult to use them in applications such as games. In this work, we propose an end-to-end pipeline that builds explicitly-represented photorealistic 3D avatars using standard 3D assets. Our key idea is the use of dynamically-generated textures to enhance the realism and visually mask deficiencies in the underlying mesh geometry. This allows for seamless integration with current graphics pipelines while achieving comparable visual quality to state-of-the-art 3D avatar generation methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。