解决单目法向估计中VAE压缩导致的边界误差问题
TransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimation

- 用几何感知损失和边缘正则化强化解码后法向精度
- 引入轻量级修正模块,降低边界处3.1°~4.2°的法向误差
- 仅需1.4%标注数据,透明物体效果提升显著
基于扩散模型的单目几何估计受限于一个未被充分研究的误差来源:VAE重建退化。VAE编码器-解码器的8倍空间压缩会损害物体边界的表面法向;即使对真实法向进行编码解码,平均角度误差(MAE)仍达1.3–8.5°,边缘区域误差为全局的2.8倍。本文提出TransNormal-2,基于FLUX.2的确定性一步推理框架,从训练监督与推理校正两方面解决解码端退化问题。首先,采用几何感知像素空间损失(包括逆渲染自洽性、von Mises-Fisher角度损失、小波边缘感知正则化),在解码后强制球面法向结构与图像形成线索。其次,设计轻量级几何修正模块(GRM),通过RGB引导残差修正,精准修复边界局部误差,不改变粗预测。在通用场景基准上,TransNormal-2在全部8项指标上持平或超越MoGe-2,且仅使用1.4%的任务特定法向标注。对透明物体尤其有效,在ClearGrasp上降低4.2° MAE,ClearPose上降低3.1°,优于最强基线。
原文摘要 · Abstract (English)
Diffusion-based models enable monocular geometry estimation, yet their pixel-space precision is limited by a shared, under-studied error source: VAE reconstruction degradation. The 8x spatial compression in the VAE encoder-decoder degrades surface normals at object boundaries; even encoding and decoding ground-truth normals introduces 1.3--8.5{\deg} of mean angular error (MAE), with edge MAE reaching 2.8x the global MAE. We present TransNormal-2, a FLUX.2-based rectified-flow framework with single-step deterministic inference that addresses this degradation on both sides of the VAE decoder: in how latent predictions are supervised during training, and in how decoded normals are corrected at inference. First, geometry-aware pixel-space losses, including inverse rendering self-consistency, von~Mises-Fisher angular loss, and wavelet edge-aware regularization, complement latent MSE by enforcing spherical normal geometry and diffuse image-formation cues after VAE decoding. Second, a lightweight Geometric Refinement Module (GRM) applies an RGB-guided residual correction to reduce boundary-localized decoding errors without freely rewriting the coarse prediction. On general-scene benchmarks, TransNormal-2 matches or exceeds MoGe-2 on all eight reported metrics while using only 1.4% as many task-specific normal annotations. The gains are clearest for transparent objects, reducing MAE by 4.2{\deg} on ClearGrasp and 3.1{\deg} on ClearPose over the strongest prior baselines. Code will be released at https://longxiang-ai.github.io/TransNormal-2.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。