一个模型动态调性能,分层服务用户,省资源又灵活。
Slice or the Whole Pie? Utility Control for AI Models
- 用可调控机制让单模型实时变性能,不需多版本
- 在图像分类等任务上实现多级性能输出,效果稳定
- 适合需要分层服务的AI产品,提升资源利用率
训练深度神经网络(DNN)越来越依赖大量标注数据、强大算力和大量微调,以满足多样应用场景。尽管预训练模型提供良好起点,但适配特定需求仍需大量定制与基础设施投入。当单一模型需支持不同性能要求的应用时,传统方法通常训练多个版本,效率低且难维护。为此,我们提出 NNObfuscator,一种新型性能调控机制,使模型能根据预设条件动态调整自身表现。不同于为每个用户单独部署模型,该机制允许单个模型实时适应不同需求,实现分级访问:免费用户获得基础性能,付费用户享更高能力。实验在图像分类、语义分割及文生图任务上验证,使用 ResNet、DeepLab、VGG16、FCN 与 Stable Diffusion 等模型。结果表明,该方法显著提升模型适应性,使单模型可处理广泛任务而无需大幅修改。
原文摘要 · Abstract (English)
Training deep neural networks (DNNs) has become an increasingly resource-intensive task, requiring large volumes of labeled data, substantial computational power, and considerable fine-tuning efforts to achieve optimal performance across diverse use cases. Although pre-trained models offer a useful starting point, adapting them to meet specific user needs often demands extensive customization, and infrastructure overhead. This challenge grows when a single model must support diverse appli-cations with differing requirements for performance. Traditional solutions often involve training multiple model versions to meet varying requirements, which can be inefficient and difficult to maintain. In order to overcome this challenge, we propose NNObfuscator, a novel utility control mechanism that enables AI models to dynamically modify their performance according to predefined conditions. It is different from traditional methods that need separate models for each user. Instead, NNObfuscator allows a single model to be adapted in real time, giving you controlled access to multiple levels of performance. This mechanism enables model owners set up tiered access, ensuring that free-tier users receive a baseline level of performance while premium users benefit from enhanced capabilities. The approach improves resource allocation, reduces unnecessary computation, and supports sustainable business models in AI deployment. To validate our approach, we conducted experiments on multiple tasks, including image classification, semantic segmentation, and text to image generation, using well-established models such as ResNet, DeepLab, VGG16, FCN and Stable Diffusion. Experimental results show that NNObfuscator successfully makes model more adaptable, so that a single trained model can handle a broad range of tasks without requiring a lot of changes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。