轻量级图像超分模型MambaLiteSR,适配边缘设备高效部署。
MambaLiteSR: Image Super-Resolution with Low-Rank Mamba using Knowledge Distillation
- 基于低秩Mamba架构与知识蒸馏,压缩模型规模。
- 参数减少15%仍保持高PSNR与SSIM,训练能耗降低58%。
- 适合资源受限的边缘设备,实测在Jetson Orin Nano表现优异。
生成式人工智能近年备受关注,尤其在图像超分辨率领域需求旺盛,但其在边缘设备上部署面临算力与内存限制。本文提出MambaLiteSR,一种基于Vision Mamba架构的轻量级超分辨率模型,结合状态空间块与重建模块实现高效特征提取。通过知识蒸馏,将大型Mamba教师模型的知识迁移至小型学生模型,并经由超参数调优优化性能。数学分析揭示关键参数对PSNR的影响并据此调整。实验表明,MambaLiteSR在多个基准数据集上优于现有边缘超分方法,功耗显著降低,同时保持竞争力的PSNR与SSIM。低秩近似进一步减少训练能耗。模型参数减少15%而性能损失极小,可在嵌入式NVIDIA Jetson Orin Nano上高效部署,实现尺寸、延迟与能效的优异平衡。
原文摘要 · Abstract (English)
Generative Artificial Intelligence (AI) has gained significant attention in recent years, revolutionizing various applications across industries. Among these, advanced vision models for image super-resolution are in high demand, particularly for deployment on edge devices where real-time processing is crucial. However, deploying such models on edge devices is challenging due to limited computing power and memory. In this paper, we present MambaLiteSR, a novel lightweight image Super-Resolution (SR) model that utilizes the architecture of Vision Mamba. It integrates State Space Blocks and a reconstruction module for efficient feature extraction. To optimize efficiency without affecting performance, MambaLiteSR employs knowledge distillation to transfer key insights from a larger Mamba-based teacher model to a smaller student model via hyperparameter tuning. Through mathematical analysis of model parameters and their impact on PSNR, we identify key factors and adjust them accordingly. Our comprehensive evaluation shows that MambaLiteSR outperforms state-of-the-art edge SR methods by reducing power consumption while maintaining competitive PSNR and SSIM scores across benchmark datasets. It also reduces power usage during training via low-rank approximation. Moreover, MambaLiteSR reduces parameters with minimal performance loss, enabling efficient deployment of generative AI models on resource-constrained devices. Deployment on the embedded NVIDIA Jetson Orin Nano confirms the superior balance of MambaLiteSR size, latency, and efficiency. Experiments show that MambaLiteSR achieves performance comparable to both the baseline and other edge models while using 15% fewer parameters. It also improves power consumption by up to 58% compared to state-of-the-art SR edge models, all while maintaining low energy use during training.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。