arXiv:2608.30617cs.CV2026-08

解决真实图像到CAD重建中的域偏移与参数偏差问题。

RealCAD: Towards Real-World Image-to-CAD Reconstruction under Domain Shift and Parameter Bias

论文配图:RealCAD: Towards Real-World Image-to-CAD Reconstruction under Domain Shift and Parameter Bias
图 1 · 摘自论文原文
  • 重构时将尺度信息分散到几何参数,避免参数分布集中
  • 用几何约束迁移合成图到真实图像域,提升跨域适应性
  • 多正样本对比学习支持单视图预测,适合工业设计场景

从图像重建可编辑的计算机辅助设计(CAD)模型对后续修改、制造和设计复用至关重要。然而,现有图像到CAD方法主要基于合成渲染图像,面临两大耦合挑战:合成与真实图像间显著的外观域差异,以及广泛使用数据中存在的未被注意的参数偏差。我们发现,DeepCAD采用的局部归一化使多个几何参数集中在少数离散值附近,且大量信息编码在单一尺度因子中。因此,模型可通过利用这些高频值获得虚假的高参数准确率,而非真正从输入图像推断几何。本文提出RealCAD,一个在表示、图像和特征层面统一应对上述限制的框架。在表示层面,将尺度信息重新分配至对应几何参数,生成更均匀的共享尺度空间;在图像层面,通过几何约束迁移将合成渲染转换为真实图像域,同时依赖物体轮廓进行条件控制;在特征层面,采用多正样本对比目标,对齐同一CAD模型在不同视角和图像域下的表征,实现仅凭单视图进行CAD序列预测。我们进一步构建OpenRealCAD数据集,包含392个3D打印物体的四视角照片及其真实命令序列。实验表明,改进后的表示大幅降低由参数频率先验带来的准确率,使参数准确率成为更可靠的几何推理度量。RealCAD在真实域上的命令和参数准确率均有提升,同时保持了与合成域相当的性能。

原文摘要 · Abstract (English)

Reconstructing editable Computer-Aided Design (CAD) models from images is essential for downstream modification, manufacturing, and design reuse. However, existing image-to-CAD methods are developed predominantly on synthetic renderings and face two coupled obstacles: a substantial appearance domain gap between synthetic and real images, and a previously overlooked parameter bias in widely used CAD data. We show that the local normalization adopted by DeepCAD concentrates several geometric parameters around a few discrete values while encoding substantial information in a single scale factor. Consequently, a model can achieve deceptively high parameter accuracy by exploiting these frequent values rather than inferring geometry from the input image. In this paper, we propose RealCAD, a unified framework that addresses these limitations at the representation, image, and feature levels. At the representation level, we redistribute scale information to the corresponding geometric parameters, producing less concentrated parameter distributions in a shared scale space. At the image level, geometry-constrained translation converts synthetic renderings toward the real-image domain while conditioning on object contours. At the feature level, a multi-positive contrastive objective aligns representations of the same CAD model across viewpoints and image domains, enabling CAD sequence prediction from each individual view. We further introduce OpenRealCAD, comprising four-view photographs of 392 3D-printed objects paired with ground-truth command sequences. Experiments show that the revised representation substantially reduces the accuracy attainable from parameter-frequency priors, making parameter accuracy a more reliable measure of image-conditioned geometric inference. RealCAD further improves real-domain command and parameter accuracy, while retaining competitive synthetic-domain performance.

图像转CAD域适应参数优化3D重建

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。