单图生成可动画的360°三维头像,无需逐帧优化
OMEGA-Avatar: One-shot Modeling of 360° Gaussian Avatars
- 基于前馈框架,用多视角特征拼贴构建统一纹理空间
- 引入语义感知网格变形,精准还原头发结构且保持拓扑完整
- 支持一键生成、跨视角身份一致,适合虚拟人与影视制作
从单张图像生成高保真、可动画化的3D头像仍是重大挑战。我们提出OMEGA-Avatar,首个同时满足前馈性、360°全头覆盖与可动画性的框架。针对全头建模中头发表现差的问题,设计语义感知网格变形模块,融合多视角法向量优化含发FLAME头模型,保持拓扑结构。为实现高效前馈解码,提出多视角特征拼贴模块,通过可微双线性拼贴、层级UV映射与可见性感知融合,构建共享标准UV表示。该方法在所有视角间保持全局结构一致性与局部高频细节,确保360°一致性且无需实例级优化。大量实验表明,OMEGA-Avatar在360°完整性上显著超越现有基线,跨视角身份保持稳健。
原文摘要 · Abstract (English)
Creating high-fidelity, animatable 3D avatars from a single image remains a formidable challenge. We identified three desirable attributes of avatar generation: 1) the method should be feed-forward, 2) model a 360° full-head, and 3) should be animation-ready. However, current work addresses only two of the three points simultaneously. To address these limitations, we propose OMEGA-Avatar, the first feed-forward framework that simultaneously generates a generalizable, 360°-complete, and animatable 3D Gaussian head from a single image. Starting from a feed-forward and animatable framework, we address the 360° full-head avatar generation problem with two novel components. First, to overcome poor hair modeling in full-head avatar generation, we introduce a semantic-aware mesh deformation module that integrates multi-view normals to optimize a FLAME head with hair while preserving its topology structure. Second, to enable effective feed-forward decoding of full-head features, we propose a multi-view feature splatting module that constructs a shared canonical UV representation from features across multiple views through differentiable bilinear splatting, hierarchical UV mapping, and visibility-aware fusion. This approach preserves both global structural coherence and local high-frequency details across all viewpoints, ensuring 360° consistency without per-instance optimization. Extensive experiments demonstrate that OMEGA-Avatar achieves state-of-the-art performance, significantly outperforming existing baselines in 360° full-head completeness while robustly preserving identity across different viewpoints.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。