arXiv:2607.03470cs.CV2026-07

让生成的镜面反射符合物理规律,提升机器人训练数据质量

PhysMirror: Physics-Aware Mirror Object Generation

论文配图:PhysMirror: Physics-Aware Mirror Object Generation
图 1 · 摘自论文原文
  • 用3D空间先验强制几何约束,自动生成镜面场景
  • 在新数据集上反射准确率超越现有方法,且保持语义对齐
  • 适合需要真实镜面效果的机器人视觉与合成数据生成

文本到图像扩散模型在合成具身人工智能和机器人感知的训练数据时,仍难以生成物理准确的镜面反射,常因几何约束缺失导致幻觉。为此,我们提出端到端的物理感知生成框架PhysMirror,通过显式3D空间先验原生引入投影几何。该方法自动将提示物体升维为3D网格,并在模拟环境中构建数学精确的镜面场景。通过渲染此显式3D场景,提取深度图、分割图等2D条件信号,作为下游扩散模型的强引导,实现物理正确的镜面反射生成。此外,我们提出无需参考的全自动化指标镜面一致性得分(MCS),基于密集特征匹配与消失点收敛度量物理正确性。在新构建的MirrOB数据集上的实验表明,本方法在反射准确性和物理真实性上优于现有最优基线,同时保持良好的文本到图像语义对齐,为具身AI数据生成提供可靠管道。代码已开源。

原文摘要 · Abstract (English)

Synthesizing physically accurate mirror reflections remains a fundamental challenge for modern text-to-image diffusion models, which are increasingly critical for generating synthetic training data for embodied AI and robotic perception. These models typically struggle with strict geometric constraints, leading to hallucinations that degrade the utility of the synthetic data. To address this, we introduce a novel, end-to-end physics-aware generation framework namely PhysMirror that natively enforces projective geometry through explicit 3D spatial priors. Our method automatically lifts prompted objects into 3D meshes and constructs a lightweight, mathematically exact mirror scene within a simulated environment. By rendering this explicit 3D scene, we extract precise 2D conditioning elements, such as depth maps and segmentation maps, that serve as robust guiding signals for downstream diffusion models, guiding them to generate images with physically correct mirror reflections. Moreover, we introduce Mirror Consistency Score (MCS), reference-free, fully automated metric that quantifies physical correctness using dense feature matching and vanishing point convergence. Experimental results on our newly constructed MirrOB dataset demonstrate that our approach outperforms state-of-the-art baselines in reflection accuracy and physical realism, while maintaining strong text-to-image semantic alignment, providing a reliable pipeline for embodied AI data generation. The source code is released at https://duyphuc0701.github.io/PhysMirror.

镜面生成物理约束扩散模型机器人感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。