arXiv:2607.03875cs.CV2026-07

无需训练,用多平面注意力提升3D高斯渲染的近景质量

MACRO: Training-free Multi-plane Attention for Closeup Render Optimization

论文配图:MACRO: Training-free Multi-plane Attention for Closeup Render Optimization
图 1 · 摘自论文原文
  • 将近景分解为深度平面,按比例匹配参考图后编码
  • 在近景渲染中实现最优重建与感知质量,超越现有方法
  • 适合虚拟制作和交互式3D内容开发人员使用

近景渲染(超出训练相机视角的局部放大)对虚拟制作和交互式3D内容至关重要,但仍是开放挑战。3D高斯溅射(3DGS)可实现高保真、实时的新视角合成,但在近距离时质量下降。基于扩散的参考图像增强方法在此场景下产生显著伪影。我们分析发现根本原因是近景与参考视图之间的尺度差异:参考条件增强模型的特征不具备尺度不变性,导致跨视图注意力检索错误对应关系,且该错配无法在潜在空间修正,因VAE编码器不具尺度等变性。基于此分析,我们提出MACRO——一种无需训练的近景渲染优化方法。MACRO利用已知的3D结构:将近景分解为深度平面,分别在图像空间裁剪并缩放参考图以匹配各平面尺度,再施加深度感知注意力掩码,使每个令牌仅关注尺度匹配的参考图。该方法无需架构改动或额外训练。我们还构建了两个新的近景新视角合成基准和首个标准化评估协议,在两项指标上均达到当前最佳性能,优于现有3DGS及扩散类方法。

原文摘要 · Abstract (English)

Close-up rendering, zooming into a scene well beyond any training camera, is important for virtual production and interactive 3D content, yet remains an open challenge. 3D Gaussian splatting (3DGS) enables high-fidelity, real-time novel view synthesis, but its rendering quality degrades at close range. Recent diffusion-based methods that enhance the rendering by conditioning on reference images from the training set produce significant artifacts in this setting. We analyze this failure and identify its root cause: the scale gap between the close-up and reference views. We show that the features in reference-conditioned enhancement models are not scale-invariant, causing cross-view attention to retrieve incorrect correspondences when the same content appears at different scales, and that this mismatch cannot be corrected in latent space because the VAE encoder is not scale-equivariant. Building on this analysis we introduce MACRO, Multi-plane Attention for Closeup Render Optimization, a training-free method for high-quality close-up novel view synthesis from 3DGS. MACRO resolves the scale gap by leveraging the scene's known 3D structure: it decomposes the close-up into depth planes, crops and resizes references in image space to match the scale of each plane before encoding, and applies a depth-aware attention mask so each token attends only to scale-matched references. The method requires no architectural changes or additional training. We further contribute two new close-up novel view synthesis benchmarks, the first standardized evaluation protocol for this setting, and demonstrate state-of-the-art results on both, outperforming existing 3DGS and diffusion-based methods on both reconstruction and perceptual metrics. Project page: https://nitzanhod.github.io/MACRO

3D高斯近景渲染注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。