arXiv:2505.05505cs.CVeess.IV2025-05CVPR被引 8

用分层生成链解决复杂属性文本生成3D模型的错配问题

Apply Hierarchical-Chain-of-Generation to Complex Attributes Text-to-3D Generation

  • 将长描述分解为分层部件块,按遮挡顺序从内到外生成
  • 通过定位与高斯优化精准绑定属性,生成结构完整、属性准确的3D模型
  • 自动处理部件衔接,适合复杂物体如家具、角色等生成任务

现有文本生成3D模型在复杂属性物体上表现不佳。主要瓶颈在于:(1) 依赖文本编码器提取语义,对长描述理解有限,导致注意力偏移,属性绑定错误;(2) 遮挡部分需严格生成顺序与显式部件解耦。现有方法多依赖人工干预,质量不稳定。本文提出自动化分层生成链(HCoG):利用大语言模型将长描述拆分为代表不同部件的块,并根据遮挡关系从内到外排序,形成层级链。每块先粗略生成组件,再通过目标区域定位与3D高斯核优化精确绑定属性。块间引入高斯扩展与标签消除机制,通过扩展新高斯核、重分配语义标签、删除冗余核,实现无缝新增部件,不破坏已有优化结果。实验表明,HCoG能生成结构连贯、属性忠实的复杂3D物体。代码已开源:https://github.com/Wakals/GASCOL。

原文摘要 · Abstract (English)

Recent text-to-3D models can render high-quality assets, yet they still stumble on objects with complex attributes. The key obstacles are: (1) existing text-to-3D approaches typically lift text-to-image models to extract semantics via text encoders, while the text encoder exhibits limited comprehension ability for long descriptions, leading to deviated cross-attention focus, subsequently wrong attribute binding in generated results. (2) Occluded object parts demand a disciplined generation order and explicit part disentanglement. Though some works introduce manual efforts to alleviate the above issues, their quality is unstable and highly reliant on manual information. To tackle above problems, we propose a automated method Hierarchical-Chain-of-Generation (HCoG). It leverages a large language model to decompose the long description into blocks representing different object parts, and orders them from inside out according to occlusions, forming a hierarchical chain. Within each block we first coarsely create components, then precisely bind attributes via target-region localization and corresponding 3D Gaussian kernel optimization. Between blocks, we introduce Gaussian Extension and Label Elimination to seamlessly generate new parts by extending new Gaussian kernels, re-assigning semantic labels, and eliminating unnecessary kernels, ensuring that only relevant parts are added without disrupting previously optimized parts. Experiments confirm that HCoG yields structurally coherent, attribute-faithful 3D objects with complex attributes. The code is available at https://github.com/Wakals/GASCOL .

文本生成3D分层生成高斯扩散

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。