用物理规律设计注意力机制,提升大规模无线发射机识别精度。
Hamiltonian-Inspired Attention Mechanism for Scalable RF Transmitter Fingerprinting
- 引入哈密顿动力学约束值更新,保持注意力头的稳定性
- 在150个设备下仍达61.64%准确率,优于传统模型
- 适合需要高鲁棒性的大规模无线设备识别场景
射频指纹识别通过基带I/Q信号中的硬件固有偏差识别无线发射机。然而,深度学习模型在接收端和信道分布变化下性能下降,尤其在发射机数量增加时更为明显。本文提出哈密顿变换器,一种物理信息注意力架构,通过学习反对称生成器与Störmer-Verlet蛙跳积分步,强制每个注意力头的值更新保持范数不变。额外引入相位增量嵌入,暴露振荡器动态。所有实验基于WiSig数据集的非均衡原始I/Q信号,涵盖同日分类、跨接收机泛化、跨日泛化及最多150个设备的扩展测试。哈密顿变换器在同日条件下达到99.12%准确率,在150设备下仍保持61.64%准确率,显著优于CNN与标准Transformer。消融实验证明,值更新的范数保持是提升可扩展性的主要归纳偏置,相位增量嵌入带来单组件最大改进。结果表明,在注意力机制中嵌入物理结构先验,是处理原始无线信号大规模发射机识别的有效方法。
原文摘要 · Abstract (English)
Radio-frequency (RF) fingerprinting identifies wire-less transmitters using hardware-induced imperfections present in baseband I/Q signals. However, deep learning models often degrade under receiver and channel distribution shifts, particularly as transmitter populations grow. This work proposes the Hamiltonian Transformer, a physics-informed attention architecture that enforces norm preserving value dynamics within each attention head using a learned skew-symmetric generator and a Störmer-Verlet leapfrog integration step. An additional phase-increment embedding exposes oscillator dynamics at the input layer. All experiments use non-equalized raw I/Q signals from the WiSig dataset under four protocols: same-day classification, cross-receiver generalisation, cross-day generalisation, and transmitter scaling up to 150 devices. The Hamiltonian Transformer achieves 99.12% accuracy under same-day conditions and 61.64% at 150 transmitters, consistently outperforming CNN and Transformer baselines across all scale points. A controlled ablation study identifies norm-preservation in the value update as the primary inductive bias driving the scaling advantage, with the phase increment embedding providing the single largest per-component improvement. These results indicate that embedding physics-informed structural priors into attention mechanisms is an effective approach to large-scale transmitter identification on raw wireless signals.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。