用检测+大模型半自动构建多类门的标注数据集
DoorDet: Semi-Automated Multi-Class Door Detection Dataset via Object Detection and Large Language Models
- 先用检测模型找门,再让大模型根据视觉和上下文分类
- 人工校验确保标签质量,大幅降低标注成本
- 适合做建筑图纸分析、智能设计等领域的研究者
在建筑平面图中准确检测并分类多种门类型对建筑合规检查、室内场景理解等应用至关重要。然而,针对细粒度多类门检测的公开数据集仍然稀缺。本文提出一种半自动化流程:首先使用先进的目标检测模型将门统一检测为一类;接着利用大语言模型(LLM)基于视觉与上下文特征对每个检测实例进行分类;最后通过人机协作环节确保标签与边界框的高质量。该方法显著降低了标注成本,同时构建出可用于神经网络模型评估的多类门检测数据集。研究表明,结合深度学习与多模态推理可在复杂现实领域实现高效数据集构建。
原文摘要 · Abstract (English)
Accurate detection and classification of diverse door types in floor plans drawings is critical for multiple applications, such as building compliance checking, and indoor scene understanding. Despite their importance, publicly available datasets specifically designed for fine-grained multi-class door detection remain scarce. In this work, we present a semi-automated pipeline that leverages a state-of-the-art object detector and a large language model (LLM) to construct a multi-class door detection dataset with minimal manual effort. Doors are first detected as a unified category using a deep object detection model. Next, an LLM classifies each detected instance based on its visual and contextual features. Finally, a human-in-the-loop stage ensures high-quality labels and bounding boxes. Our method significantly reduces annotation cost while producing a dataset suitable for benchmarking neural models in floor plan analysis. This work demonstrates the potential of combining deep learning and multimodal reasoning for efficient dataset construction in complex real-world domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。