arXiv:2607.28581cs.CV2026-07

用判别模型的先验知识降低3D生成训练成本,仅需1.5%数据达工业级效果

ROAD: Reciprocal-Objective Alignment of Discriminative Semantics for 3D Shape Generation

论文配图:ROAD: Reciprocal-Objective Alignment of Discriminative Semantics for 3D Shape Generation
图 1 · 摘自论文原文
  • 通过双向对齐策略迁移判别模型语义结构先验到生成模型
  • 仅用1.5%训练数据即达到工业基线性能,大幅降低计算开销
  • 适用于追求高效高保真3D生成的科研与工业用户

高保真3D生成主要依赖模型容量和数据规模的扩展,带来巨大计算成本。该范式通常从零学习几何,忽视了判别性3D基础模型中蕴含的丰富语义与结构先验。我们主张利用这些判别模型对3D世界的深刻理解,可显著降低生成成本。为此,提出ROAD框架,通过将判别性先验迁移到扩散变换器中,降低3D生成训练成本。针对生成与判别隐空间间的语义-结构异质性,引入双向目标对齐策略:通过整体语义压缩强化全局语义一致性,通过二分图匹配形式的结构最优对齐,严格对齐不同隐空间间的微观几何细节。3D基础模型仅用于训练阶段的对齐监督,推理时无需使用,不增加额外开销。相比工业基线Step1X-3D,ROAD在仅1.5%训练数据下实现具有竞争力的生成性能,显著降低训练成本,有效缓解高保真3D生成的计算负担。代码见https://github.com/H-EmbodVis/ROAD。

原文摘要 · Abstract (English)

High-fidelity 3D generation predominantly relies on scaling model capacity and data, which incurs prohibitive computational costs. This paradigm typically requires learning geometry from scratch and overlooks the rich semantic and structural priors already encapsulated in discriminative 3D foundation models. We contend that leveraging the profound understanding of the 3D world possessed by these discriminative models can significantly reduce generative cost. To this end, we propose ROAD, a framework that reduces the training cost of 3D generation by transferring these rich discriminative priors into diffusion transformers. To address the inherent semantic-structural heterogeneity between generative and discriminative latents, we introduce a reciprocal-objective alignment strategy. This method synergizes Holistic Semantic Condensing to enforce global semantic coherence and Structural Optimal Alignment, which is formulated as a bipartite matching problem to rigorously align microscopic geometric details between disparate latent spaces. The 3D foundation model is only used for training-time supervision of alignment and is not used at inference, incurring no additional inference cost. Compared with the industrial baseline Step1X-3D, the proposed ROAD achieves highly competitive generation performance with only 1.5% of the training data and significantly reduces training costs, effectively reducing the computational overhead of high-fidelity 3D generation. Code is available at https://github.com/H-EmbodVis/ROAD.

3D生成扩散模型知识迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。