arXiv:2606.04376eess.IVcs.MM2026-06

解耦标定与融合,实现高效实时多视角点云重建

FUSE-Flow: A Decoupled Framework for Calibration and Stateless Real-Time Multi-View Point Cloud Fusion

  • 分离标定与融合模块,避免优化目标冲突
  • 无需标定板即可实现高精度稀疏视图标定
  • 状态无关设计支持大规模系统扩展

实时多相机3D重建是沉浸式媒体、远程交互和空间计算的关键基础。尽管同步相机阵列广泛使用,但实现几何一致且可扩展的实时重建仍具挑战性。核心难题在于外参标定、多视图融合与全局优化之间的紧密耦合,导致结果波动、累积误差和系统扩展性差。本文提出一种解耦框架FUSE-Flow,包含两个协同组件:几何对齐多视角外参标定(GMAC)与可靠性引导多视图点云融合(FUSE)。GMAC模块通过几何约束与多视图重建变换器,实现无需标定板、密集图像或全局捆绑调整的高精度稀疏视图标定。FUSE模块采用置信度加权与自适应空间哈希,实现无状态融合,保证线性时间与内存消耗。两模块相互增强:精确位姿提升融合精度,置信度感知融合纠正标定偏差。在公开数据集与真实相机设置上验证,FUSE-Flow在视觉效果、动态稳定性与可扩展性上优于主流实时重建方法,为大规模实时3D重建提供实用方案。

原文摘要 · Abstract (English)

Real-time multi-camera 3D reconstruction is a key foundation for immersive media, remote interaction and spatial computing. While synchronized camera arrays are widely adopted, achieving geometrically consistent and scalable real-time reconstruction remains challenging. A key challenge is the close linkage among extrinsic calibration, multi-view fusion and global optimization, which causes fluctuating reconstruction results, cumulative errors and poor system expandability. We propose a decoupled framework for calibration and stateless real-time multi-view point cloud fusion (FUSE-Flow), a framework with two collaborative components: geometry-aligned multi-view extrinsic calibration (GMAC) and reliability-guided multi-view point cloud fusion (FUSE). This split design avoids conflicting optimization objectives for targeted improvement. The GMAC module refines camera extrinsics via geometric constraints and multi-view reconstruction transformers, enabling accurate sparse-view calibration without calibration targets, dense images or global bundle adjustment. The FUSE module integrates confidence weighting and adaptive spatial hashing for stateless fusion, ensuring linear time and memory consumption. The two modules mutually reinforce each other: accurate camera poses boost fusion accuracy, and confidence-aware fusion corrects calibration biases. Validated on public datasets and real camera setups, FUSE-Flow outperforms mainstream real-time reconstruction methods in visual effect, dynamic stability and scalability, providing a practical solution for large-scale real-time 3D reconstruction.

3D重建点云融合实时系统标定解耦

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。