arXiv:2509.16748cs.CV2025-09NeurIPS被引 8

提出新型混合平面表示,解决头像生成中的特征纠缠与细节丢失问题。

HyPlaneHead: Rethinking Tri-plane-like Representations in Full-Head Image Synthesis

  • 设计混合平面结构,融合平面与球面优势,避免特征干扰。
  • 采用近似等面积映射,提升特征图利用率,改善渲染细节。
  • 单通道统一特征图设计,杜绝通道间干扰,适合高保真人脸生成。

三平面表示因高效性被广泛用于3D感知生成模型的头像合成及其他3D建模任务。然而,通过笛卡尔坐标投影查询特征常导致特征纠缠,引发镜像伪影。近期工作SphereHead引入球面三平面以缓解此问题,但其正方形特征图与球面平面间映射不均,造成特征利用效率低下,难以生成精细图像细节。此外,三平面与球面三平面均存在通道间特征穿透问题,当某一平面主导时,易引发其他平面干扰。本文首次系统分析上述问题,并提出创新解决方案:引入新型混合平面(hy-plane)表示,结合平面与球面优点,规避各自缺陷;改进球面平面,以近似等面积映射替代传统theta-phi扭曲,最大化特征图有效利用;生成器采用单通道统一特征图,消除通道间特征穿透。经一系列技术优化,所提HyPlaneHead在全头图像合成任务中达到当前最优性能。

原文摘要 · Abstract (English)

Tri-plane-like representations have been widely adopted in 3D-aware GANs for head image synthesis and other 3D object/scene modeling tasks due to their efficiency. However, querying features via Cartesian coordinate projection often leads to feature entanglement, which results in mirroring artifacts. A recent work, SphereHead, attempted to address this issue by introducing spherical tri-planes based on a spherical coordinate system. While it successfully mitigates feature entanglement, SphereHead suffers from uneven mapping between the square feature maps and the spherical planes, leading to inefficient feature map utilization during rendering and difficulties in generating fine image details. Moreover, both tri-plane and spherical tri-plane representations share a subtle yet persistent issue: feature penetration across convolutional channels can cause interference between planes, particularly when one plane dominates the others. These challenges collectively prevent tri-plane-based methods from reaching their full potential. In this paper, we systematically analyze these problems for the first time and propose innovative solutions to address them. Specifically, we introduce a novel hybrid-plane (hy-plane for short) representation that combines the strengths of both planar and spherical planes while avoiding their respective drawbacks. We further enhance the spherical plane by replacing the conventional theta-phi warping with a novel near-equal-area warping strategy, which maximizes the effective utilization of the square feature map. In addition, our generator synthesizes a single-channel unified feature map instead of multiple feature maps in separate channels, thereby effectively eliminating feature penetration. With a series of technical improvements, our hy-plane representation enables our method, HyPlaneHead, to achieve state-of-the-art performance in full-head image synthesis.

3D生成图像合成特征表示人脸生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。