让传统渲染引擎也能高效显示逼真3D人脸动画
LegacyAvatars: Volumetric Face Avatars For Traditional Graphics Pipelines
- 用参数化人脸模型+辐射场构建分层网格与纹理
- 部署时仅需线性混合纹理即可实现表情动画
- 可直接在老式图形平台流式播放，无需定制开发
我们提出一种新型表示方法，用于在经典渲染管线中高效呈现逼真3D人脸动画。基于锚定于参数化人脸模型的最新辐射场进展，该方法实现了对头发、皮肤、眼睛等复杂面部特征的可控体渲染。注册阶段，我们在3D空间中学习一组辐射场流形，提取出显式的分层网格，并生成外观与变形纹理。部署阶段，可通过在静态网格上简单地线性混合和透明合成纹理来控制与动画人脸。这种显式表示使生成的人脸动画可高效流式传输，并使用传统网格与着色器渲染在遗留图形平台上运行，无需任何定制工程或集成。
原文摘要 · Abstract (English)
We introduce a novel representation for efficient classical rendering of photorealistic 3D face avatars. Leveraging recent advances in radiance fields anchored to parametric face models, our approach achieves controllable volumetric rendering of complex facial features, including hair, skin, and eyes. At enrollment time, we learn a set of radiance manifolds in 3D space to extract an explicit layered mesh, along with appearance and warp textures. During deployment, this allows us to control and animate the face through simple linear blending and alpha compositing of textures over a static mesh. This explicit representation also enables the generated avatar to be efficiently streamed online and then rendered using classical mesh and shader-based rendering on legacy graphics platforms, eliminating the need for any custom engineering or integration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。