arXiv:2510.11992cs.CVcs.AI2025-10被引 2

用薄板样条变换,从一张全景图精准推断房间三维布局。

PanoTPS-Net: Panoramic Room Layout Estimation via Thin Plate Spline Transformation

  • 结合卷积网络与薄板样条变换,分两阶段预测布局。
  • 在多个数据集上3DIoU最高达91.98,对非立方体布局也有效。
  • 适合做全景图房间重建的科研人员和工程师参考。

准确估计房间三维布局是计算机视觉中的关键任务,具有在机器人、增强现实和室内设计中的应用潜力。本文提出一种新模型 PanoTPS-Net,仅需单张全景图像即可估计房间布局。该模型由两阶段组成:首先,卷积神经网络从输入图像中提取高层特征,学习薄板样条(TPS)变换的空间参数;其次,基于预测参数生成TPS空间变换层,将参考布局变形为所需布局。这种设计使模型能准确预测布局,并有效泛化至立方体与非立方体布局。在公开数据集上的大量实验表明,该方法优于现有技术。结果显示,模型在 PanoContext、Stanford-2D3D、Matterport3DLayout 与 ZInD 数据集上的 3DIoU 分别达到 85.49、86.16、81.76 和 91.98,验证了 TPS 变换与全景图像的兼容性及模型鲁棒性。源代码已开源:https://github.com/HatemHosam/PanoTPS_Net。

原文摘要 · Abstract (English)

Accurately estimating the 3D layout of rooms is a crucial task in computer vision, with potential applications in robotics, augmented reality, and interior design. This paper proposes a novel model, PanoTPS-Net, to estimate room layout from a single panorama image. Leveraging a Convolutional Neural Network (CNN) and incorporating a Thin Plate Spline (TPS) spatial transformation, the architecture of PanoTPS-Net is divided into two stages: First, a convolutional neural network extracts the high-level features from the input images, allowing the network to learn the spatial parameters of the TPS transformation. Second, the TPS spatial transformation layer is generated to warp a reference layout to the required layout based on the predicted parameters. This unique combination empowers the model to properly predict room layouts while also generalizing effectively to both cuboid and non-cuboid layouts. Extensive experiments on publicly available datasets and comparisons with state-of-the-art methods demonstrate the effectiveness of the proposed method. The results underscore the model's accuracy in room layout estimation and emphasize the compatibility between the TPS transformation and panorama images. The robustness of the model in handling both cuboid and non-cuboid room layout estimation is evident with a 3DIoU value of 85.49, 86.16, 81.76, and 91.98 on PanoContext, Stanford-2D3D, Matterport3DLayout, and ZInD datasets, respectively. The source code is available at: https://github.com/HatemHosam/PanoTPS_Net.

全景图布局估计薄板样条

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。