arXiv:2411.13544cs.CV2024-11被引 9

DIS-Mine在地下矿井暗光环境下实现灾情区域实例分割,助力救援人员快速定位危险区域。

DIS-Mine: Instance Segmentation for Disaster-Awareness in Poor-Light Condition in Underground Mines

  • 融合SAM与Mask R-CNN,结合亮度增强与特征匹配提升暗光图像分割能力
  • 在ImageMine数据集上达到86.0% F1分数和72.0% mIoU,精度比现有方法最高提升80%
  • 专为低光照矿井设计,适合应急救援、智能采矿等实际场景使用

地下矿井灾害(如爆炸、结构损毁)的检测长期面临挑战,尤其对缺乏现场信息的一线救援人员而言。矿井内光线极弱甚至全黑,极大阻碍了搜救效率,造成严重生命损失。本文提出一种新型实例分割方法DIS-Mine,专为低光或无光环境下的矿井灾情识别设计,帮助救援人员快速判断受损区域。DIS-Mine通过四个核心组件应对高噪声、色彩失真和对比度下降问题:图像亮度增强、基于SAM的实例分割、基于Mask R-CNN的分割建模,以及特征匹配引导的掩码对齐。同时,研究团队采集了真实矿井环境下的低可见度图像,构建新数据集ImageMine,用于验证模型在真实复杂场景中的表现。在ImageMine及其他多个数据集上的实验表明,DIS-Mine取得86.0% F1分数与72.0% mIoU,优于当前最优方法,在目标检测精度上至少提升15倍,最高达80%。

原文摘要 · Abstract (English)

Detecting disasters in underground mining, such as explosions and structural damage, has been a persistent challenge over the years. This problem is compounded for first responders, who often have no clear information about the extent or nature of the damage within the mine. The poor-light or even total darkness inside the mines makes rescue efforts incredibly difficult, leading to a tragic loss of life. In this paper, we propose a novel instance segmentation method called DIS-Mine, specifically designed to identify disaster-affected areas within underground mines under low-light or poor visibility conditions, aiding first responders in rescue efforts. DIS-Mine is capable of detecting objects in images, even in complete darkness, by addressing challenges such as high noise, color distortions, and reduced contrast. The key innovations of DIS-Mine are built upon four core components: i) Image brightness improvement, ii) Instance segmentation with SAM integration, iii) Mask R-CNN-based segmentation, and iv) Mask alignment with feature matching. On top of that, we have collected real-world images from an experimental underground mine, introducing a new dataset named ImageMine, specifically gathered in low-visibility conditions. This dataset serves to validate the performance of DIS-Mine in realistic, challenging environments. Our comprehensive experiments on the ImageMine dataset, as well as on various other datasets demonstrate that DIS-Mine achieves a superior F1 score of 86.0% and mIoU of 72.0%, outperforming state-of-the-art instance segmentation methods, with at least 15x improvement and up to 80% higher precision in object detection.

实例分割灾情检测低光图像矿井安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。