arXiv:2502.08884cs.CVcs.AI2025-02被引 2

用大模型生成可复用的3D形状程序化抽象库,支持语义化设计与编辑。

ShapeLib: Designing a library of programmatic 3D shape abstractions with Large Language Models

  • 结合大模型与几何推理,从文本意图和示例形状中自动发现形状抽象函数。
  • 在多个形状类别上实现跨分布泛化,新抽象函数能准确匹配原始示例形状。
  • 生成的抽象库支持可解释的语义接口,适用于形状编辑与生成等下游任务。

我们提出ShapeLib,首个利用大语言模型(LLM)先验知识设计程序化3D形状抽象库的方法。系统接收两种用户输入:高层文本描述需包含的功能,以及少量示例形状。通过引导式LLM工作流,先提出函数的应用与实现方式,再验证其对示例形状的表示有效性。为扩展至种子集之外,我们开发了针对库的识别网络,将形状(以基元、体素或点云表示)映射到使用新发现抽象函数的程序。在多个建模领域(按形状类别划分),我们发现,经过精心设计的LLM结合几何推理,可生成泛化能力跨越形状分布的抽象函数库。该框架朝着实现长期存在的形状分析目标迈出一步——发现可复用、程序化的形状抽象,并提供可解释、语义对齐的接口。大量评估表明,ShapeLib在泛化性、可用性和操作后合理性方面优于以往抽象发现方法。最后,我们展示这些抽象函数可赋能下游应用,结合LLM对形状程序的推理与几何处理工具,支持形状编辑与生成流程。

原文摘要 · Abstract (English)

We present ShapeLib, the first method that uses the priors of Large Language Models (LLMs) to design libraries of programmatic 3D shape abstractions. Our system accepts two forms of user-provided design intent: high-level text descriptions of functions to include in the output library and a small seed set of exemplar shapes. We discover a library of abstractions that matches this design intent with a guided LLM workflow that first proposes different ways of applying and implementing functions, and then validates these functions are helpful in representing seed set shapes. To extend beyond the seed set, we develop library-specific recognition networks that map shapes (represented as primitives, voxels, or point clouds) to programs that use these newly discovered abstractions. Across multiple modeling domains (split by shape category), we find that LLMs, when thoughtfully combined with geometric reasoning, can be guided to author libraries of abstraction functions that generalize across shape distributions. Our framework takes a step towards realizing the long-standing shape analysis aspiration of discovering reusable, programmatic shape abstractions while exposing interpretable, semantically aligned interfaces. Our extensive evaluation demonstrates that ShapeLib provides distinct advantages over prior alternative abstraction discovery works in terms of generalization, usability, and maintaining plausibility under manipulation. Finally, we demonstrate that ShapeLib's abstraction functions unlock a number of downstream applications, combining LLM reasoning over shape programs with geometry processing tools to support shape editing and generation workflows.

3D生成程序化抽象大模型应用形状编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。