将位图平面图转为精准矢量图,支持斜墙弧线等复杂结构。
FloorplanVLM: A Vision-Language Model for Floorplan Vectorization
- 把平面图转矢量任务视为图像条件下的序列生成,直接输出结构化JSON
- 在基准测试中外墙重合率达92.52%,对非曼哈顿结构有良好泛化能力
- 构建了大规模数据集和评测基准,适合建筑与设计领域研究者
将位图平面图转化为工程级矢量图形面临拓扑复杂和几何约束严格的问题。为此,我们提出FloorplanVLM,一种统一框架,将平面图矢量化重新定义为图像条件下的序列建模任务。不同于依赖脆弱启发式规则的像素方法或生成碎片化房间的查询式Transformer,我们的模型直接输出表示全局拓扑的结构化JSON序列。这种‘像素到序列’范式实现了复杂几何(如斜墙、曲线弧)的精确且整体的约束满足。为支持这一数据密集型方法,我们构建了大规模数据集(Floorplan-2M)和高保真子集(Floorplan-HQ-300K),以平衡几何多样性与像素级精度。随后采用渐进式训练策略:先通过监督微调(SFT)进行结构定位与质量优化,再用组相对策略优化(GRPO)实现严格几何对齐。为标准化复杂布局评估,我们建立了并开源了FPBench-2K。在该严格基准上,FloorplanVLM展现出卓越的结构有效性,外墙交并比达92.52%,并在非曼哈顿架构上表现稳健。
原文摘要 · Abstract (English)
Converting raster floorplans into engineering-grade vector graphics is challenging due to complex topology and strict geometric constraints. To address this, we present FloorplanVLM, a unified framework that reformulates floorplan vectorization as an image-conditioned sequence modeling task. Unlike pixel-based methods that rely on fragile heuristics or query-based transformers that generate fragmented rooms, our model directly outputs structured JSON sequences representing the global topology. This 'pixels-to-sequence' paradigm enables the precise and holistic constraint satisfaction of complex geometries, such as slanted walls and curved arcs. To support this data-hungry approach, we introduce a scalable data engine: we construct a large-scale dataset (Floorplan-2M) and a high-fidelity subset (Floorplan-HQ-300K) to balance geometric diversity and pixel-level precision. We then employ a progressive training strategy, using Supervised Fine-Tuning (SFT) for structural grounding and quality annealing, followed by Group Relative Policy Optimization (GRPO) for strict geometric alignment. To standardize evaluation on complex layouts, we establish and open-source FPBench-2K. Evaluated on this rigorous benchmark, FloorplanVLM demonstrates exceptional structural validity, achieving $\textbf{92.52%}$ external-wall IoU and robust generalization across non-Manhattan architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。