arXiv:2512.17573cs.CV2025-12被引 1

用共享参数扩散模型实现高保真家具合成,背景完整且泛化能力强。

RoomEditor++: A Parameter-Sharing Diffusion Architecture for High-Fidelity Furniture Synthesis

  • 采用参数共享双扩散架构,统一特征提取与修复过程。
  • 在11万+训练对上表现超越现有方法,人类评估更偏好其结果。
  • 适合家居设计、电商场景的高质量虚拟家具生成应用。

虚拟家具合成旨在将参考物体无缝融入室内场景,同时保持几何一致性和视觉真实感,在家居设计和电商领域具有重要潜力。然而,由于缺乏可复现的基准数据集以及现有图像合成方法在保持背景完整性方面的局限,该领域仍鲜有研究。为此,我们首先构建了RoomBench++,一个公开可用的综合性基准数据集,包含112,851对训练样本和1,832对测试样本,数据源自真实室内视频与逼真家装渲染图,支持在实际条件下进行可靠训练与评估。随后提出RoomEditor++,一种基于扩散模型的通用架构,采用参数共享的双扩散主干,兼容U-Net与DiT结构。该设计统一了参考物与背景图像的特征提取与修复流程。深入分析表明,参数共享机制强化了特征表示的一致性,从而实现精准几何变换、纹理保留与无缝融合。大量实验验证,RoomEditor++在定量指标、定性评估及人工偏好测试中均优于当前最优方法,且无需任务微调即可良好泛化至未见室内场景与一般场景。代码与数据集已开源。

原文摘要 · Abstract (English)

Virtual furniture synthesis, which seamlessly integrates reference objects into indoor scenes while maintaining geometric coherence and visual realism, holds substantial promise for home design and e-commerce applications. However, this field remains underexplored due to the scarcity of reproducible benchmarks and the limitations of existing image composition methods in achieving high-fidelity furniture synthesis while preserving background integrity. To overcome these challenges, we first present RoomBench++, a comprehensive and publicly available benchmark dataset tailored for this task. It consists of 112,851 training pairs and 1,832 testing pairs drawn from both real-world indoor videos and realistic home design renderings, thereby supporting robust training and evaluation under practical conditions. Then, we propose RoomEditor++, a versatile diffusion-based architecture featuring a parameter-sharing dual diffusion backbone, which is compatible with both U-Net and DiT architectures. This design unifies the feature extraction and inpainting processes for reference and background images. Our in-depth analysis reveals that the parameter-sharing mechanism enforces aligned feature representations, facilitating precise geometric transformations, texture preservation, and seamless integration. Extensive experiments validate that RoomEditor++ is superior over state-of-the-art approaches in terms of quantitative metrics, qualitative assessments, and human preference studies, while highlighting its strong generalization to unseen indoor scenes and general scenes without task-specific fine-tuning. The dataset and source code are available at \url{https://github.com/stonecutter-21/roomeditor}.

家具生成扩散模型图像修复

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。