arXiv:2604.13730cs.CV2026-04中稿 · CVPR

解决文本生成3D模型的持续学习问题,防止旧知识遗忘。

ReConText3D: Replay-based Continual Text-to-3D Generation

论文配图:ReConText3D: Replay-based Continual Text-to-3D Generation
图 1 · 摘自论文原文
  • 用文本嵌入k-Center选取出高效回放记忆库。
  • 在新类别上生成高质量3D模型,同时保留旧类性能。
  • 首个文本到3D生成的持续学习框架与基准数据集。

持续学习使模型能随时间不断获取新知识,同时保留已有能力。然而,其在文本到3D生成中的应用尚未探索。本文提出ReConText3D,首个面向持续学习的文本到3D生成框架。我们首先发现现有文本到3D模型在增量训练下存在灾难性遗忘。ReConText3D使生成模型能从文本描述中逐步学习新3D类别,同时保持对已有资产的合成能力。该方法通过文本嵌入k-Center选择构建紧凑且多样化的回放记忆库,无需修改底层架构即可实现有效知识回放。为系统评估持续文本到3D学习,我们引入Toys4K-CL基准,源自Toys4K数据集,提供均衡且语义多样的类别增量划分。在Toys4K-CL上的大量实验表明,ReConText3D在不同生成骨干网络上均显著优于所有基线,对新旧类别均保持高质量生成。据我们所知,本工作首次建立了文本到3D生成的持续学习框架与基准,开辟了增量3D生成建模的新方向。

原文摘要 · Abstract (English)

Continual learning enables models to acquire new knowledge over time while retaining previously learned capabilities. However, its application to text-to-3D generation remains unexplored. We present ReConText3D, the first framework for continual text-to-3D generation. We first demonstrate that existing text-to-3D models suffer from catastrophic forgetting under incremental training. ReConText3D enables generative models to incrementally learn new 3D categories from textual descriptions while preserving the ability to synthesize previously seen assets. Our method constructs a compact and diverse replay memory through text-embedding k-Center selection, allowing representative rehearsal of prior knowledge without modifying the underlying architecture. To systematically evaluate continual text-to-3D learning, we introduce Toys4K-CL, a benchmark derived from the Toys4K dataset that provides balanced and semantically diverse class-incremental splits. Extensive experiments on the Toys4K-CL benchmark show that ReConText3D consistently outperforms all baselines across different generative backbones, maintaining high-quality generation for both old and new classes. To the best of our knowledge, this work establishes the first continual learning framework and benchmark for text-to-3D generation, opening a new direction for incremental 3D generative modeling. Project page is available at: https://mauk95.github.io/ReConText3D/.

3D生成持续学习文本生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。