仅用手机拍摄的RGB视频，就能重建并动画化高细节眼睑。
High-quality Animatable Eyelid Shapes from Lightweight Captures
- 结合眼球静态动态信息，自动校准参数实现低资源捕获。
- 相比同类方法，在相同采集条件下还原更精细的眼睑结构。
- 适合影视特效、虚拟人开发等需要真实眼睑动画的场景。
高精度眼睑重建与动画因细节微妙且形变复杂而困难，以往方法常在采集成本与细节质量间权衡。本文提出新方法，仅需手机拍摄的RGB视频即可实现高细节眼睑重建与动画。利用眼球位置与旋转等静态动态信息，配合自动眼球校准技术获取所需参数。此外，设计神经眼睑控制模块，实现语义级眼睑动画控制。据我们所知，这是首个基于轻量级捕获的高质量眼睑重建与动画方法。在合成与真实数据上的大量实验表明，本方法在相同采集条件下，相比现有方法生成更精细、更逼真的结果。代码已开源：https://github.com/StoryMY/AniEyelid。
原文摘要 · Abstract (English)
High-quality eyelid reconstruction and animation are challenging for the subtle details and complicated deformations. Previous works usually suffer from the trade-off between the capture costs and the quality of details. In this paper, we propose a novel method that can achieve detailed eyelid reconstruction and animation by only using an RGB video captured by a mobile phone. Our method utilizes both static and dynamic information of eyeballs (e.g., positions and rotations) to assist the eyelid reconstruction, cooperating with an automatic eyeball calibration method to get the required eyeball parameters. Furthermore, we develop a neural eyelid control module to achieve the semantic animation control of eyelids. To the best of our knowledge, we present the first method for high-quality eyelid reconstruction and animation from lightweight captures. Extensive experiments on both synthetic and real data show that our method can provide more detailed and realistic results compared with previous methods based on the same-level capture setups. The code is available at https://github.com/StoryMY/AniEyelid.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品；中文卡片由大模型生成，请以原文为准。