arXiv:2607.16352cs.CVcs.AI2026-07中稿 · ACM Multimedia 202…

让AI主动提问澄清模糊指令,提升3D生成任务成功率。

Clarify Before Executing: A Self-Evolving Agent for Resolving Intent Asymmetry in 3D Tool Orchestration

论文配图:Clarify Before Executing: A Self-Evolving Agent for Resolving Intent Asymmetry in 3D Tool Orchestration
图 1 · 摘自论文原文
  • 将生成流程拆分为四个认知角色,先澄清再执行。
  • 在单步和多步任务中分别达60.4%和43.3%成功率,超基线一倍以上。
  • 适合需要高精度3D创作的设计师与非专业用户。

当前3D内容生成面临核心矛盾:先进工具需精确参数,但普通用户常给出模糊指令。现有3D代理将模糊性视为噪声,采用单轮盲目执行。本文提出CLARE,一种具备澄清能力且可自演化的新一代3D代理,将意图不对称视为对话机会而非错误。通过四类专用认知角色,CLARE在调用计算成本高的3D工具前主动解析不完整指令,支持文本到3D生成、单视图重建、多视图重建、点云编辑及后期处理等五类任务。关键创新在于,它不依赖人工规则,而是通过模拟多轮交互优化多轮奖励,自我演进澄清策略,平衡交互效率与任务完成度。为验证效果,构建包含620个场景的3D-Clarify基准,系统注入歧义、缺失信息和错误细节。实验显示,CLARE在单步任务中成功率达60.40%,多步任务达43.34%,均超过现有方法一倍以上。定量与定性结果一致表明,主动澄清是实现鲁棒3D执行的关键。代码已开源。

原文摘要 · Abstract (English)

A fundamental intent asymmetry plagues modern 3D asset creation: while state-of-the-art 3D toolchains demand precise, executable parameters, ordinary users typically provide vague, underspecified instructions. Current 3D agents treat this ambiguity as noise, defaulting to blind execution under a single-turn assumption. To address this limitation, we introduce CLARE, a clarification-aware and evolutionary 3D agent that treats intent asymmetry not as an execution error, but as an opportunity for strategic dialogue. By decoupling the generation pipeline into four specialized cognitive roles, CLARE intercepts and resolves underspecified instructions before invoking computationally expensive 3D tools to seamlessly execute tasks across five diverse domains: text-to-3D generation, single-view reconstruction, multi-view reconstruction, point cloud editing, and post-processing. Crucially, rather than relying on rigid manual rules, CLARE self-evolves its clarification policy via simulated multi-turn interactions. By optimizing a Multi-turn Reward, the agent internalizes the delicate balance between interaction efficiency and task completion. To rigorously test this, we construct 3D-Clarify, a comprehensive benchmark comprising 620 interaction scenarios with systematically injected ambiguity, missing information, and mistaken details. CLARE achieves state-of-the-art performance, with 60.40% and 43.34% success rates on single-step and multi-step tasks, respectively, more than doubling existing baselines. Both quantitative and qualitative results demonstrate that proactive clarification is the missing key to robust 3D execution. Code is available at https://github.com/xyzhu1225/CLARE.

3D生成智能代理主动澄清自演化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。