arXiv:2412.08266cs.CV2024-12中稿 · ICRA被引 3

用神经观测场融合梯度与非梯度优化,高效解决多相机部署难题

Neural Observation Field Guided Hybrid Optimization of Camera Placement

  • 构建神经观测场隐式编码覆盖与观测质量,支持梯度计算
  • 在多个数据集上达到顶尖性能,计算量仅为传统方法1/8
  • 适用于2D/3D场景,实测抗环境噪声能力强

多相机系统在虚拟现实、自动驾驶和高质量重建中至关重要。相机部署面临高维参数的非线性及目标函数(如覆盖范围、可见性)无梯度的问题,因此现有方法多采用非梯度优化。本文提出一种混合优化方法,结合梯度与非梯度优化优势。为连接两类方法,提出神经观测场,隐式编码覆盖与观测质量,无需假设目标场景即可提供观测测量值与梯度。该方法适用于2D平面形状、3D物体及室规模3D场景。大量实验表明,本方法性能达当前最优,计算时间仅需典型方法的1/8。此外,使用自建采集系统进行真实场景实验,验证了方法对实际环境噪声的鲁棒性。

原文摘要 · Abstract (English)

Camera placement is crutial in multi-camera systems such as virtual reality, autonomous driving, and high-quality reconstruction. The camera placement challenge lies in the nonlinear nature of high-dimensional parameters and the unavailability of gradients for target functions like coverage and visibility. Consequently, most existing methods tackle this challenge by leveraging non-gradient-based optimization methods.In this work, we present a hybrid camera placement optimization approach that incorporates both gradient-based and non-gradient-based optimization methods. This design allows our method to enjoy the advantages of smooth optimization convergence and robustness from gradient-based and non-gradient-based optimization, respectively. To bridge the two disparate optimization methods, we propose a neural observation field, which implicitly encodes the coverage and observation quality. The neural observation field provides the measurements of the camera observations and corresponding gradients without the assumption of target scenes, making our method applicable to diverse scenarios, including 2D planar shapes, 3D objects, and room-scale 3D scenes.Extensive experiments on diverse datasets demonstrate that our method achieves state-of-the-art performance, while requiring only a fraction (8x less) of the typical computation time. Furthermore, we conducted a real-world experiment using a custom-built capture system, confirming the resilience of our approach to real-world environmental noise.

相机部署神经场优化算法多视角

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。