单图个性化3D场景,解决视角偏差问题
Personalize Your Gaussian: Consistent 3D Scene Personalization from a Single Image
- 通过迭代LoRA微调扩展单图外观信息
- 生成多视角一致的引导图,提升3DGS质量
- 适合需要高保真3D个性化的用户
从单张参考图像个性化3D场景可实现直观的用户编辑,但需同时保证多视角一致性与与输入图像的参照一致性。然而,由于单图提供的视角有限,现有方法常受视角偏差影响,难以获得一致结果。为此,本文提出一致个性化3D高斯溅射框架CP-GS,通过预训练图像到3D生成模型与迭代LoRA微调,逐步将单视图参考外观传播至新视角。最终在几何线索引导下,通过视图一致生成过程,输出高质量的引导图与个性化3DGS结果。大量真实场景实验表明,CP-GS有效缓解视角偏差,显著优于现有方法。
原文摘要 · Abstract (English)
Personalizing 3D scenes from a single reference image enables intuitive user-guided editing, which requires achieving both multi-view consistency across perspectives and referential consistency with the input image. However, these goals are particularly challenging due to the viewpoint bias caused by the limited perspective provided in a single image. Lacking the mechanisms to effectively expand reference information beyond the original view, existing methods of image-conditioned 3DGS personalization often suffer from this viewpoint bias and struggle to produce consistent results. Therefore, in this paper, we present Consistent Personalization for 3D Gaussian Splatting (CP-GS), a framework that progressively propagates the single-view reference appearance to novel perspectives. In particular, CP-GS integrates pre-trained image-to-3D generation and iterative LoRA fine-tuning to extract and extend the reference appearance, and finally produces faithful multi-view guidance images and the personalized 3DGS outputs through a view-consistent generation process guided by geometric cues. Extensive experiments on real-world scenes show that our CP-GS effectively mitigates the viewpoint bias, achieving high-quality personalization that significantly outperforms existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。