arXiv:2606.04871cs.CV2026-06

系统梳理神经与原始基3D表示的演进,揭示隐式表示如何重塑三维视觉流程。

Recent Advances and Trends in Learning-based 3D Representations

论文配图:Recent Advances and Trends in Learning-based 3D Representations
图 1 · 摘自论文原文
  • 按离散显式到连续隐式的脉络,分类解析各类3D表示的原理与变体
  • 对比传统网格/点云与新兴3D高斯溅射等方法在效率与可微性上的差异
  • 聚焦隐式表示范式变革,适合关注三维生成与渲染前沿的研究者

选择合适的3D表示是现代计算机视觉与图形学流程中的关键设计决策,直接影响3D重建、新视角合成与渲染、形状运动分析、识别与生成等任务的效率、质量与能力。尽管传统表示(如网格、点云、体素网格)仍是激光雷达和3D扫描仪的标准输出,并广泛用于编辑与仿真等下游应用,但近期基于神经网络与原始基的表示(如3D高斯溅射)提供了紧凑且可微的替代方案,在游戏、增强现实/虚拟现实、自动驾驶、机器人导航、医学成像等领域展现出广阔应用前景。本文旨在全面调研从离散显式格式到连续隐式场的主流3D表示,涵盖基于神经渲染与原始溅射的方法。针对每类表示,我们阐述其通用形式与变体,讨论优缺点,并突出关键应用场景。最后,我们指出当前开放挑战与未来研究方向。与现有泛化覆盖3D物体与场景重建的综述不同,本文聚焦3D表示本身的演进历程,特别强调向隐式表示的范式转变,为理解这些新兴格式如何从根本上重构3D/4D工作流提供全新视角。

原文摘要 · Abstract (English)

The selection of an appropriate 3D representation is a fundamental design decision that dictates the efficiency, quality, and capabilities of modern computer vision and graphics pipelines for tasks such as 3D reconstruction, novel-view synthesis and rendering, shape and motion analysis, recognition, and generation. While traditional representations (\eg meshes, point clouds, and volumetric grids) remain standard outputs of 3D sensors (\eg LiDAR and 3D scanners) and are widely used in downstream applications (\eg editing and simulation), recent neural and primitive-based representations (\eg 3D Gaussian Splatting) offer compact and differentiable alternatives opening a wide range of opportunities in applications such as games, AR/VR, autonomous driving, robot navigation, and medical imaging, to name a few. The goal of this paper is to survey the main families of 3D representations from discrete explicit formats to continuous implicit fields based either on neural rendering or primitive splatting. For each type of representation, we present the general formulation and its variants, discuss its benefits and limitations, and highlight key applications. We conclude the paper by outlining the open challenges and potential directions for future research. Distinct from recent surveys that broadly cover 3D object and scene reconstruction, this paper provides a focused analysis on the evolution of 3D representations themselves. We specifically emphasize the paradigm shift toward implicit representations, offering a novel perspective on how these emerging formats fundamentally alter 3D/4D workflows.

3D表示隐式表示神经渲染高斯溅射

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。