arXiv:2507.19261cs.AIcs.LG2025-07被引 1

将大模型精华特征嫁接到小模型,显著减小体积同时提升性能。

Knowledge Grafting: A Mechanism for Optimizing AI Model Deployment in Resource-Constrained Environments

  • 从大模型提取关键特征移植到小模型,实现高效知识迁移。
  • 模型体积缩小88.54%(64.39MB→7.38MB),验证准确率提升至89.97%。
  • 适合边缘设备部署,尤其适用于农业等资源受限场景。

人工智能的广泛应用导致模型规模不断增大,对计算资源需求高,在许多实际应用中难以满足。本文提出知识嫁接机制,通过将大型捐赠模型中的精选特征(接穗)迁移到小型主干模型中,优化模型在资源受限环境下的部署表现。该方法使模型大小减少88.54%(从64.39 MB降至7.38 MB),同时提升泛化能力:新模型验证准确率达89.97%(原捐赠模型为87.47%),验证损失更低(0.2976 vs. 0.5068),在未见测试数据上达到90.45%准确率。该方法突破了模型大小与性能间的权衡困境,使AI系统可在资源受限设备上部署并获得更优表现。我们在农业杂草检测场景中验证了该方法,其思路可推广至多种边缘计算场景,有望加速在硬件/软件支持有限区域的AI落地,如同园艺嫁接促进困难农业环境中的高效种植。

原文摘要 · Abstract (English)

The increasing adoption of Artificial Intelligence (AI) has led to larger, more complex models with numerous parameters that require substantial computing power -- resources often unavailable in many real-world application scenarios. Our paper addresses this challenge by introducing knowledge grafting, a novel mechanism that optimizes AI models for resource-constrained environments by transferring selected features (the scion) from a large donor model to a smaller rootstock model. The approach achieves an 88.54% reduction in model size (from 64.39 MB to 7.38 MB), while improving generalization capability of the model. Our new rootstock model achieves 89.97% validation accuracy (vs. donor's 87.47%), maintains lower validation loss (0.2976 vs. 0.5068), and performs exceptionally well on unseen test data with 90.45% accuracy. It addresses the typical size vs performance trade-off, and enables deployment of AI frameworks on resource-constrained devices with enhanced performance. We have tested our approach on an agricultural weed detection scenario, however, it can be extended across various edge computing scenarios, potentially accelerating AI adoption in areas with limited hardware/software support -- by mirroring in a similar manner the horticultural grafting enables productive cultivation in challenging agri-based environments.

模型压缩知识迁移边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。