通过图像内空间信息提升室内重建的视角不变性
Image-Plane Geometric Decoding for View-Invariant Indoor Scene Reconstruction
- 在单图中解码三维结构信息,减少对多视角几何约束依赖
- 视图数量减少40%时性能保持率仍达99.7%,最大下降仅0.42%
- 适合低视角密度场景,如移动设备或受限采集环境
基于体素的室内场景重建方法具备优异泛化能力与实时部署潜力。然而,现有方法依赖多视角像素反投影射线交点作为弱几何约束来确定空间位置,导致重建质量受输入视角密度影响显著,在重叠区域与未观测区域性能下降。为解决此问题,我们通过利用单张图像内的空间信息,降低对视间几何约束的依赖。提出一种图像平面解码框架,包含三个核心组件:像素级置信度编码器、仿射补偿模块和图像平面空间解码器。这些模块通过物理成像过程解码图像中编码的三维结构信息,有效保留边缘、空腔结构及复杂纹理等空间几何特征,显著提升视角不变重建效果。在室内场景重建数据集上的实验表明,该方法具有优越的重建稳定性:当视图数量减少40%时,系数变异仅为0.24%,性能保留率达99.7%,最大性能下降为0.42%。结果证明,挖掘图像内空间信息为视图受限场景提供了鲁棒解决方案。
原文摘要 · Abstract (English)
Volume-based indoor scene reconstruction methods offer superior generalization capability and real-time deployment potential. However, existing methods rely on multi-view pixel back-projection ray intersections as weak geometric constraints to determine spatial positions. This dependence results in reconstruction quality being heavily influenced by input view density. Performance degrades in overlapping regions and unobserved areas.To address these limitations, we reduce dependency on inter-view geometric constraints by exploiting spatial information within individual views. We propose an image-plane decoding framework with three core components: Pixel-level Confidence Encoder, Affine Compensation Module, and Image-Plane Spatial Decoder. These modules decode three-dimensional structural information encoded in images through physical imaging processes. The framework effectively preserves spatial geometric features including edges, hollow structures, and complex textures. It significantly enhances view-invariant reconstruction.Experiments on indoor scene reconstruction datasets confirm superior reconstruction stability. Our method maintains nearly identical quality when view count reduces by 40%. It achieves a coefficient of variation of 0.24%, performance retention rate of 99.7%, and maximum performance drop of 0.42%. These results demonstrate that exploiting intra-view spatial information provides a robust solution for view-limited scenarios in practical applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。