用置信度与距离一致性实现多视角点云实时高效融合
FUSE-Flow: Scalable Real-Time Multi-View Point Cloud Reconstruction Using Confidence
- 每帧独立生成点云片段,通过置信度和3D距离加权融合
- 自适应哈希分区处理稀疏稠密区域,线性扩展支持多相机
- 在现代GPU上实现实时帧率,适用于动态与复杂场景
实时多视角点云重建是三维视觉与沉浸感知的核心问题,广泛应用于VR、AR、机器人导航、数字孪生和人机交互。尽管多摄像头系统和高分辨率深度传感器取得进展,但在严格实时约束下将大规模多视角深度观测融合为高质量点云仍具挑战。现有基于体素融合、时间累积或全局优化的方法存在计算复杂度高、内存占用大、可扩展性差等问题,难以同时满足实时性、重建质量和多相机扩展性。本文提出FUSE-Flow,一种逐帧、无状态、线性可扩展的点云流式重建框架。每帧独立生成点云片段,通过测量置信度和3D距离一致性权重进行融合,抑制噪声并保留几何细节。针对大规模多相机效率,引入基于自适应空间哈希的加权聚合方法:根据局部点云密度自适应划分3D空间,每单元选取代表性点,执行加权融合以应对稀疏与稠密区域。结合GPU并行化,FUSE-Flow实现高吞吐、低延迟的点云生成与融合,具有线性复杂度。实验表明,该框架在重叠区、深度不连续和动态场景中提升重建稳定性与几何保真度,同时在现代GPU上保持实时帧率,验证了其有效性、鲁棒性与可扩展性。
原文摘要 · Abstract (English)
Real-time multi-view point cloud reconstruction is a core problem in 3D vision and immersive perception, with wide applications in VR, AR, robotic navigation, digital twins, and computer interaction. Despite advances in multi-camera systems and high-resolution depth sensors, fusing large-scale multi-view depth observations into high-quality point clouds under strict real-time constraints remains challenging. Existing methods relying on voxel-based fusion, temporal accumulation, or global optimization suffer from high computational complexity, excessive memory usage, and limited scalability, failing to simultaneously achieve real-time performance, reconstruction quality, and multi-camera extensibility. We propose FUSE-Flow, a frame-wise, stateless, and linearly scalable point cloud streaming reconstruction framework. Each frame independently generates point cloud fragments, fused via two weights, measurement confidence and 3D distance consistency to suppress noise while preserving geometric details. For large-scale multi-camera efficiency, we introduce an adaptive spatial hashing-based weighted aggregation method: 3D space is adaptively partitioned by local point cloud density, representative points are selected per cell, and weighted fusion is performed to handle both sparse and dense regions. With GPU parallelization, FUSE-Flow achieves high-throughput, low-latency point cloud generation and fusion with linear complexity. Experiments demonstrate that the framework improves reconstruction stability and geometric fidelity in overlapping, depth-discontinuous, and dynamic scenes, while maintaining real-time frame rates on modern GPUs, verifying its effectiveness, robustness, and scalability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。