仅用单视角视频就能还原真实人脸外观，无需专业设备。
Monocular Facial Appearance Capture in the Wild
- 单视频+简单头部转动，重建人脸几何与光照属性
- 无需假设环境光照，自动处理遮挡和可见性问题
- 效果接近专业多视角拍摄，但操作更简便成本低
我们提出一种新方法，从轻量级的野外单视角视频中重建人脸外观特性。该方法在无约束环境下，仅需包含简单头部旋转的单视频，即可恢复表面几何、漫反射反照率、镜面强度和镜面粗糙度。值得注意的是，本方法不假设环境光照条件，且明确考虑了可见性和遮挡问题。结果表明，所生成的人脸外观图质量接近专业工作室多视角采集的水平，但采集流程更简便、成本更低。
原文摘要 · Abstract (English)
We present a new method for reconstructing the appearance properties of human faces from a lightweight capture procedure in an unconstrained environment. Our method recovers the surface geometry, diffuse albedo, specular intensity and specular roughness from a monocular video containing a simple head rotation in-the-wild. Notably, we make no simplifying assumptions on the environment lighting, and we explicitly take visibility and occlusions into account. As a result, our method can produce facial appearance maps that approach the fidelity of studio-based multi-view captures, but with a far easier and cheaper procedure.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。