用多智能体协作检测建筑缺陷并生成高质量训练数据
Synergistic Perception and Generative Recomposition: A Multi-Agent Orchestration for Expert-Level Building Inspection
- 设计多智能体协同框架,分工处理缺陷检测与语义重构
- 在六类墙面缺陷上实现像素级精准识别,性能超越现有方法
- 适合基础设施智能巡检、数据稀缺场景的算法研究者
建筑立面缺陷检测对结构健康监测和城市可持续维护至关重要,但受极端几何变化、低对比度背景及复合缺陷(如裂缝与剥落共现)影响,导致像素分布失衡与特征模糊。加之高质量像素级标注稀缺,现有检测与分割模型泛化能力受限。为此,我们提出统一的多智能体框架 FacadeFixer,将缺陷感知视为协同推理任务而非孤立识别。该框架协调专用检测与分割智能体应对多类型缺陷干扰,并联合生成智能体实现语义重构,将复杂缺陷从噪声背景中解耦,真实合成至多样清洁纹理,生成高保真增强数据及精确专家级掩码。为此,我们构建了涵盖六类主要立面类别、带像素级标注的综合性多任务数据集。大量实验表明,FacadeFixer 显著优于当前最先进基线,尤其在捕捉像素级结构异常方面表现突出,验证了生成合成在解决基础设施巡检数据稀缺问题上的有效性。代码与数据集将公开发布。
原文摘要 · Abstract (English)
Building facade defect inspection is fundamental to structural health monitoring and sustainable urban maintenance, yet it remains a formidable challenge due to extreme geometric variability, low contrast against complex backgrounds, and the inherent complexity of composite defects (e.g., cracks co-occurring with spalling). Such characteristics lead to severe pixel imbalance and feature ambiguity, which, coupled with the critical scarcity of high-quality pixel-level annotations, hinder the generalization of existing detection and segmentation models. To address gaps, we propose \textit{FacadeFixer}, a unified multi-agent framework that treats defect perception as a collaborative reasoning task rather than isolated recognition. Specifically,\textit{FacadeFixer} orchestrates specialized agents for detection and segmentation to handle multi-type defect interference, working in tandem with a generative agent to enable semantic recomposition. This process decouples intricate defects from noisy backgrounds and realistically synthesizes them onto diverse clean textures, generating high-fidelity augmented data with precise expert-level masks. To support this, we introduce a comprehensive multi-task dataset covering six primary facade categories with pixel-level annotations. Extensive experiments demonstrate that \textit{FacadeFixer} significantly outperforms state-of-the-art (SOTA) baselines. Specifically, it excels in capturing pixel-level structural anomalies and highlights generative synthesis as a robust solution to data scarcity in infrastructure inspection. Our code and dataset will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。