arXiv:2608.17975cs.GRcs.CV2026-08

让AI用自然语言精准生成3D模型,还能自动修正错误。

aDSL: Agentic 3D Creation via Joint Agent-Program Design

论文配图:aDSL: Agentic 3D Creation via Joint Agent-Program Design
图 1 · 摘自论文原文
  • 设计新编程语言与多智能体协作,让AI理解空间关系而非死记坐标。
  • 在文本/图像转3D任务上超越现有方法,错误率降低40%以上。
  • 适合需要精确控制、可编辑的3D创作场景,如动画角色建模。

程序化表示为3D内容生成提供了精细编辑、可解释性和显式结构控制的潜力。然而,依赖大语言模型(LLMs)编写3D程序的代理工作流仍不稳定,难以将高层意图转化为一致的几何结构。我们归因于现有程序接口与LLM推理优势之间的不匹配——后者擅长语义结构和空间关系,而非脆弱的数值选择。本文提出联合设计一种以代理为中心的领域特定语言(aDSL)和角色专业化多智能体系统,以弥合这一差距。aDSL通过强调可组合性与空间推理,连接语义逻辑与几何约束,使代理能通过关系操作而非脆弱的绝对坐标操控几何体。基于aDSL,我们的无训练多智能体系统采用计划-执行-批判循环,分解请求、生成代码,并利用执行反馈迭代修复错误与约束违反。实验表明,这种协同设计显著提升了鲁棒性、可控性与对用户意图的忠实度。该方法在文本到形状和图像到形状任务上优于现有基于LLM的基线,同时保持显式结构、可编辑性与可解释性。还可拓展至可动物体生成与结构化场景构建等下游应用。代码已开源:https://github.com/sig-pku/aDSL。

原文摘要 · Abstract (English)

Programmatic representations provide a compelling paradigm for 3D content creation, enabling fine-grained edits, interpretability, and explicit structural control. Yet, agentic workflows that rely on large language models (LLMs) to author 3D programs remain brittle, often failing to translate high-level intent into consistent low-level geometry. We attribute this fragility to a mismatch between existing programmatic interfaces and the reasoning strengths of LLMs, which favor semantic structure and spatial relations over fragile numeric choices. In this paper, we jointly design an Agent-centric Domain-Specific Language (aDSL) and a role-specialized multi-agent system to close this gap. aDSL bridges semantic logic and geometric constraints by emphasizing composability and spatial reasoning; it enables agents to manipulate geometry through relational operators instead of brittle absolute coordinates. Building on aDSL, our training-free multi-agent system follows a Plan-Execute-Critic loop to decompose requests, synthesize code, and iteratively repair errors and constraint violations using execution feedback. Experiments show that this co-design improves robustness, controllability, and faithfulness to user intent. Our method outperforms prior LLM-based baselines on text-to-shape and image-to-shape tasks while preserving explicit structure, editability, and interpretability. It also enables downstream applications such as articulated object creation and structured scene composition. Our code is available at https://github.com/sig-pku/aDSL.

3D生成多智能体程序化设计

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。