arXiv:2606.03460cs.CV2026-06

用3D点云和图结构实现矿井实时安全监测,识别隐患并追溯历史模式。

From 3D Perception to Safety Reasoning: A Graph-Based Framework for Real-Time Underground Mine Monitoring

  • 将3D点云转为可追踪的图结构,融合感知、推理与记忆分析。
  • 结合上下文大模型和历史数据,危险检测覆盖率从57%提升至93%。
  • 适用于矿井安全监控,尤其适合复杂环境下的长期风险预警。

地下煤矿作业需在共享、封闭且照明差的环境中进行,设备靠近、结构失稳和视线盲区等隐患难以预判。传统监控系统如固定摄像头和规则式近距报警仅能检测预设事件,缺乏三维场景理解与上下文记忆能力。本文提出一种持续监控框架,将彩色3D点云转化为结构化、可追溯的安全推理输出。该框架整合3D语义感知、基于不确定性的异常检测、规则化隐患检查、本地部署的大语言模型推理以及基于GraphRAG的记忆分析,以识别即时隐患并解读长期安全趋势。场景与时间图作为显式知识结构,连接各推理阶段的输出。针对地下标注数据稀缺问题,结合真实巷道扫描、可控物体摆放及高保真长壁模拟生成多样化隐患场景,并通过自监督预训练提升有限标注下的分割性能。感知模型在30 FPS下达到92.7%准确率,内存开销低。在115个隐患场景中,规则检查覆盖率为57%,结合上下文大模型推理提升至76%,加入历史记录的基于记忆推理后达93%。定性结果表明,基于不确定性的异常信号有助于识别超出预定义类别的分布外隐患。整体上,图结构知识表示结合3D感知与分层安全推理,为地下矿井智能决策支持提供了实用基础。

原文摘要 · Abstract (English)

Underground coal mining requires personnel and heavy equipment to operate within shared, confined, and poorly illuminated spaces where hazards such as equipment proximity violations, structural instabilities, and occluded blind spots are difficult to anticipate. Conventional monitoring systems, including fixed cameras and rule-based proximity alerts, can detect predefined events but lack the 3D scene understanding and contextual memory needed to identify complex or evolving hazards. This paper presents a continuous monitoring framework that converts colourised 3D point clouds into structured and traceable safety reasoning outputs. The framework combines 3D semantic perception, uncertainty-based anomaly detection, rule-based hazard checks, on-device LLM reasoning, and GraphRAG -based memory analysis to identify immediate hazards and interpret longer-term safety patterns. Scene and temporal graphs serve as the explicit knowledge structure, linking perception outputs across reasoning stages. To overcome the scarcity of labeled underground data, real roadway scans, controlled object placement, and high-fidelity longwall simulation were combined to generate diverse hazard scenarios, while self-supervised pretraining improved segmentation from limited annotations. The perception model achieved 92.7% accuracy at 30 FPS with low memory usage. Across 115 hazard scenarios, rule-based checks achieved 57% coverage, increasing to 76% with contextual LLM reasoning and 93% with memory-based reasoning using historical records. Qualitative results show uncertainty-derived anomaly signals support the interpretation of out-of-distribution hazards beyond predefined classes. Overall, graph-based knowledge representation combined with 3D perception and layered safety reasoning provides a practical foundation for intelligent decision support in underground mine monitoring.

矿井安全3D感知图神经网络智能监控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。