arXiv:2607.12000cs.CV2026-07中稿 · ECCV

单图生成新视角,兼顾几何一致与精准控制。

MetaView: Monocular Novel View Synthesis with Scale-Aware Implicit Geometry Priors

论文配图:MetaView: Monocular Novel View Synthesis with Scale-Aware Implicit Geometry Priors
图 1 · 摘自论文原文
  • 用隐式几何先验+少量显式3D线索,平衡灵活性与结构一致性。
  • 在大视角变化下显著优于现有方法,生成图像更稳定真实。
  • 适合需要高精度可控生成的视觉生成任务,如3D重建与虚拟拍摄。

当前视觉生成模型虽能生成高质量内容,但缺乏对空间结构的连贯感知。现有生成式新视角合成方法通常引入显式几何先验,虽保证空间一致性,却限制了大视角变化下的泛化能力。相比之下,近期交互式生成方法偏好隐式场景建模,灵活性更高,但牺牲了精确相机控制与几何一致性。本文提出MetaView,一种基于扩散模型的单图新视角合成框架,可在单一图像基础上实现大视角变化下的渲染。核心思想是结合隐式几何建模与最小必要的显式3D提示:通过前馈几何感知网络引入隐式几何先验以正则化结构,同时利用度量深度锚定生成结果至度量尺度。该设计使MetaView在保持几何一致性的同时具备精确可控性。大量实验表明,在挑战性的单目大视角变化场景下,MetaView显著优于现有方法,展现出更强泛化能力。代码已公开于https://github.com/KlingAIResearch/MetaView。

原文摘要 · Abstract (English)

Current visual generation models are capable of producing high-quality content, yet they lack a coherent perception of the spatial structure. Existing generative novel view synthesis methods typically introduce explicit geometry priors, which enforce spatial consistency but inherently restrict generalization in large view changes. In contrast, recent interactive generative methods favor implicit scene modeling, offering greater flexibility at the cost of precise camera control and geometry consistency. In this paper, we propose MetaView, a diffusion-based monocular novel view synthesis framework that enables rendering under large view changes from a single image. Our key insight is to combine implicit geometry modeling with minimal yet essential explicit 3D cues: we incorporate implicit geometry priors from a feed-forward geometry perception network to regularize structure without imposing restrictive reconstruction pipelines, while leveraging metric depth to anchor the generation to a metric scale. This design allows MetaView to achieve both geometry consistency and precise controllability. Extensive experiments demonstrate that, under challenging monocular large viewpoint changes, MetaView significantly outperforms existing methods and exhibits superior generalization. Our code is publicly available at https://github.com/KlingAIResearch/MetaView.

新视角合成扩散模型隐式几何单图生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。