arXiv:2506.09814cs.CV2025-06被引 6

用无配对3D数据训练奖励模型,让文本生成3D更符合人类偏好。

DreamCS: Geometry-Aware Text-to-3D Generation with Unpaired 3D Reward Supervision

  • 构建首个大规模无配对3D偏好数据集3D-MeshPref
  • 提出新损失函数,直接在3D数据上学习几何偏好
  • 集成到生成流程,提升3D形状准确性和人类满意度

尽管文本生成3D受到广泛关注,现有方法常难以生成符合人类偏好的3D资产。当前的偏好对齐技术依赖难获取的多视图2D图像配对数据来训练2D奖励模型,导致固有的2D偏差引发几何瑕疵。为此,我们构建了首个大规模无配对3D偏好数据集3D-MeshPref,包含由大语言模型标注并经人工评估优化的多样化3D网格。我们进一步提出RewardCS,首个基于新颖柯西-施瓦茨散度目标、直接在无配对3D-MeshPref数据上训练的奖励模型,实现无需配对比较的人类对齐3D几何偏好学习。在此基础上,我们提出DreamCS统一框架,将RewardCS融入文本生成3D流程,增强隐式与显式3D生成中的人类偏好反馈。大量实验表明,DreamCS优于先前方法,生成的3D资产兼具几何保真度与人类偏好。代码与模型将公开发布。

原文摘要 · Abstract (English)

While text-to-3D generation has attracted growing interest, existing methods often struggle to produce 3D assets that align well with human preferences. Current preference alignment techniques for 3D content typically rely on hardly-collected preference-paired multi-view 2D images to train 2D reward models, when then guide 3D generation -- leading to geometric artifacts due to their inherent 2D bias. To address these limitations, we construct 3D-MeshPref, the first large-scale unpaired 3D preference dataset, featuring diverse 3D meshes annotated by a large language model and refined by human evaluators. We then develop RewardCS, the first reward model trained directly on unpaired 3D-MeshPref data using a novel Cauchy-Schwarz divergence objective, enabling effective learning of human-aligned 3D geometric preferences without requiring paired comparisons. Building on this, we propose DreamCS, a unified framework that integrates RewardCS into text-to-3D pipelines -- enhancing both implicit and explicit 3D generation with human preference feedback. Extensive experiments show DreamCS outperforms prior methods, producing 3D assets that are both geometrically faithful and human-preferred. Code and models will be released publicly.

文本生成3D3D偏好几何感知奖励模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。