arXiv:2604.06254cs.CRcs.AI2026-04被引 6

用注意力机制改进视觉变压器,提升工业医疗物联网入侵检测精度与速度。

SE-Enhanced ViT and BiLSTM-Based Intrusion Detection for Secure IIoT and IoMT Environments

  • 用压缩激励注意力替代传统注意力,结合双向LSTM增强特征提取。
  • 在两个数据集上准确率达99.33%,误报率低于0.0014%,单次检测延迟低于0.0005秒。
  • 适合需要高精度低延迟的工业和医疗物联网安全场景。

随着工业物联网(IIoT)和医疗物联网(IoMT)中互联设备的快速增长,实现及时且精准的网络威胁检测已成为关键挑战。本文提出一种基于混合挤压-激励注意力视觉变换器-双向长短期记忆(SE ViT-BiLSTM)架构的先进入侵检测框架。该设计将视觉变换器的传统多头注意力机制替换为挤压-激励注意力,并融合双向LSTM层,以提升检测准确率与计算效率。模型在真实世界基准数据集EdgeIIoT和CICIoMT2024上进行训练与评估,涵盖使用合成少数类过采样技术(SMOTE)和RandomOverSampler进行数据平衡前后的结果。实验表明,该模型在多项指标上优于现有方法:未平衡时,在EdgeIIoT上达到99.11%准确率(误报率:0.0013%,延迟:0.00032秒/实例),在CICIoMT2024上达96.10%准确率(误报率:0.0036%,延迟:0.00053秒/实例);经平衡后性能进一步提升,于EdgeIIoT上达99.33%准确率(延迟:0.00035秒/实例),于CICIoMT2024上达98.16%准确率(延迟:0.00014秒/实例)。

原文摘要 · Abstract (English)

With the rapid growth of interconnected devices in Industrial and Medical Internet of Things (IIoT and MIoT) ecosystems, ensuring timely and accurate detection of cyber threats has become a critical challenge. This study presents an advanced intrusion detection framework based on a hybrid Squeeze-and-Excitation Attention Vision Transformer-Bidirectional Long Short-Term Memory (SE ViT-BiLSTM) architecture. In this design, the traditional multi-head attention mechanism of the Vision Transformer is replaced with Squeeze-and-Excitation attention, and integrated with BiLSTM layers to enhance detection accuracy and computational efficiency. The proposed model was trained and evaluated on two real-world benchmark datasets; EdgeIIoT and CICIoMT2024; both before and after data balancing using the Synthetic Minority Over-sampling Technique (SMOTE) and RandomOverSampler. Experimental results demonstrate that the SE ViT-BiLSTM model outperforms existing approaches across multiple metrics. Before balancing, the model achieved accuracies of 99.11% (FPR: 0.0013%, latency: 0.00032 sec/inst) on EdgeIIoT and 96.10% (FPR: 0.0036%, latency: 0.00053 sec/inst) on CICIoMT2024. After balancing, performance further improved, reaching 99.33% accuracy with 0.00035 sec/inst latency on EdgeIIoT and 98.16% accuracy with 0.00014 sec/inst latency on CICIoMT2024.

入侵检测视觉变换器医疗物联网低延迟

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。