arXiv:2512.23176cs.CV2025-12

融合高斯与体素表示,提升无深度监督下的3D目标检测精度。

GVSynergy-Det: Synergistic Gaussian-Voxel Representations for Multi-View 3D Object Detection

  • 设计双表示架构,联合学习高斯点云与体素网格的几何特征。
  • 在ScanNetV2和ARKitScenes上达到当前最优性能,无需深度标注。
  • 适用于追求高精度且无3D标注数据的室内场景检测任务。

基于图像的3D目标检测旨在仅使用RGB图像实现三维空间中的物体识别与定位,避免点云方法对昂贵深度传感器的依赖。现有方法面临两大挑战:高精度方法通常需要密集3D监督,而无监督方法难以从图像中准确提取几何信息。本文提出GVSynergy-Det,一种通过协同高斯-体素表示学习增强3D检测的新框架。核心思想是连续高斯与离散体素表示可互补建模几何:高斯擅长捕捉精细表面细节,体素提供结构化空间上下文。我们构建双表示架构,一方面将通用高斯溅射适配于检测任务以提取互补几何特征;另一方面设计跨表示增强机制,将高斯场中的几何细节注入体素特征。相比以往依赖逐场景优化或仅用高斯进行深度正则的方法,本方案通过可学习融合直接利用两类表示特征,实现更精准定位。大量实验表明,GVSynergy-Det在挑战性室内基准(ScanNetV2与ARKitScenes)上均达到当前最优表现,且完全无需深度或密集3D几何监督(如点云或TSDF)。

原文摘要 · Abstract (English)

Image-based 3D object detection aims to identify and localize objects in 3D space using only RGB images, eliminating the need for expensive depth sensors required by point cloud-based methods. Existing image-based approaches face two critical challenges: methods achieving high accuracy typically require dense 3D supervision, while those operating without such supervision struggle to extract accurate geometry from images alone. In this paper, we present GVSynergy-Det, a novel framework that enhances 3D detection through synergistic Gaussian-Voxel representation learning. Our key insight is that continuous Gaussian and discrete voxel representations capture complementary geometric information: Gaussians excel at modeling fine-grained surface details while voxels provide structured spatial context. We introduce a dual-representation architecture that: 1) adapts generalizable Gaussian Splatting to extract complementary geometric features for detection tasks, and 2) develops a cross-representation enhancement mechanism that enriches voxel features with geometric details from Gaussian fields. Unlike previous methods that either rely on time-consuming per-scene optimization or utilize Gaussian representations solely for depth regularization, our synergistic strategy directly leverages features from both representations through learnable integration, enabling more accurate object localization. Extensive experiments demonstrate that GVSynergy-Det achieves state-of-the-art results on challenging indoor benchmarks, significantly outperforming existing methods on both ScanNetV2 and ARKitScenes datasets, all without requiring any depth or dense 3D geometry supervision (e.g., point clouds or TSDF).

3D检测高斯表示体素无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。