arXiv:2504.10880cs.CVcs.RO2025-04CVPR被引 7

用3D多视角理解提升工地安全违规识别,效果显著优于现有方法。

Safe-Construct: Redefining Construction Safety Violation Recognition as 3D Multi-View Engagement Task

  • 将安全违规识别重构为3D多视角交互任务,融合场景上下文与空间关系。
  • 在四种违规类型上相比顶尖模型提升7.6%,且在遮挡和光照变化下表现稳健。
  • 自研合成数据生成器支持多样化场景训练,适合工业级安全监控应用。

识别建筑环境中的安全违规至关重要,但当前计算机视觉研究仍不充分。现有模型主要依赖2D目标检测,因:(i) 将违规识别简化为单一物体检测任务;(ii) 缺乏真实条件下的有效验证;(iii) 无标准化基准;(iv) 受限于缺乏多样施工场景的合成数据生成器。为此,我们提出Safe-Construct,首个将违规识别重构为3D多视角交互任务的框架,利用场景级工人-物体上下文与3D空间理解。同时提出合成室内施工现场生成器(SICSG),生成多样化可扩展训练数据,克服数据瓶颈。Safe-Construct在四个违规类型上相较最先进方法提升7.6%。我们在近真实环境下严格评估,涵盖四种违规、四名工人、14类物体,以及遮挡(工人-物体、工人-工人)与光照变化(逆光、过曝、阳光)等挑战性条件。通过整合3D多视角空间理解与合成数据生成,Safe-Construct为高风险行业提供了可扩展、鲁棒的安全监测新基准。

原文摘要 · Abstract (English)

Recognizing safety violations in construction environments is critical yet remains underexplored in computer vision. Existing models predominantly rely on 2D object detection, which fails to capture the complexities of real-world violations due to: (i) an oversimplified task formulation treating violation recognition merely as object detection, (ii) inadequate validation under realistic conditions, (iii) absence of standardized baselines, and (iv) limited scalability from the unavailability of synthetic dataset generators for diverse construction scenarios. To address these challenges, we introduce Safe-Construct, the first framework that reformulates violation recognition as a 3D multi-view engagement task, leveraging scene-level worker-object context and 3D spatial understanding. We also propose the Synthetic Indoor Construction Site Generator (SICSG) to create diverse, scalable training data, overcoming data limitations. Safe-Construct achieves a 7.6% improvement over state-of-the-art methods across four violation types. We rigorously evaluate our approach in near-realistic settings, incorporating four violations, four workers, 14 objects, and challenging conditions like occlusions (worker-object, worker-worker) and variable illumination (back-lighting, overexposure, sunlight). By integrating 3D multi-view spatial understanding and synthetic data generation, Safe-Construct sets a new benchmark for scalable and robust safety monitoring in high-risk industries. Project Website: https://Safe-Construct.github.io/Safe-Construct

安全识别3D视觉合成数据工地监控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。