用多模态深度学习精准分割电解槽材料,助力绿色氢能可持续制造
Multi-Modal Semantic Segmentation of Electrolyzer Components for Sustainable Hydrogen Technologies: A Dual-Branch Deep Learning Approach

- 融合高光谱与可见光图像,双分支网络捕捉材料光谱与空间特征
- 在电解槽数据集上达到91.66%准确率和0.82 mIoU,跨数据集泛化能力出色
- 适用于电解槽自动化拆解与氢能源设备智能维护场景
精确分割电解槽材料对氢能技术中的自动化拆解、可持续回收和循环制造至关重要。然而,材料间视觉相似性高、光谱重叠严重、形状不规则且类别极不平衡,使该任务极具挑战。为此,我们提出一种基于人工智能的双分支框架——高光谱-可见光电解槽材料网络(HREM-Net),融合高光谱成像(HSI)与RGB图像实现材料分割。通过引入高效通道注意力、坐标注意力、移动倒置瓶颈模块及空洞空间金字塔池化,有效提取HSI与RGB图像的多维特征。结合自适应门控跨模态融合模块与复合损失函数,HREM-Net在Electrolyzers-HSI数据集上取得91.66%的平均分类准确率与0.82的平均交并比(mIoU),显著优于基线模型。在PCB-Vision数据集上的跨数据集验证表明其具备强泛化能力,准确率达96.91%,mIoU达0.93。该工作为提升电解槽效率与氢气生产预测性维护提供了工业级应用潜力。
原文摘要 · Abstract (English)
Accurate segmentation of electrolyzer materials is essential for automated disassembly, sustainable recycling, and circular manufacturing in hydrogen technologies. However, this task is challenging due to strong visual similarity between materials, spectral overlap, irregular shapes, and severe class imbalance. To address these challenges, we propose an AI-driven dual-branch framework, Hyperspectral-RGB Electrolyzer Materials Network (HREM-Net), that combines hyperspectral imaging (HSI) and RGB images for electrolyzer material segmentation. We implemented several innovative modules, including Efficient Channel Attention, Coordinate Attention, Mobile Inverted Bottleneck blocks, and Atrous Spatial Pyramid Pooling to capture spectral and spatial features from HSI, and RGB images. With an adaptive gated cross-modal fusion module and composite loss function, HREM-Net achieves a mean class accuracy of 91.66% and a mean Intersection over Union (mIoU) of 0.82 on the Electrolyzers-HSI dataset, outperforming baseline segmentation models. Cross-dataset validation on the PCB-Vision dataset demonstrates strong generalization with 96.91% accuracy and 0.93 mIoU. This work poses its potential as an industrial application to improve electrolyzer efficiency, thereby improving the predictive maintenance of hydrogen production.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。