用知识蒸馏让大模型变小,适配医院本地部署
From Performance to Practice: Knowledge-Distilled Segmentator for On-Premises Clinical Workflows
- 用知识蒸馏将大模型压缩成小模型,不改现有系统
- 参数减少94%仍保持98.7%的分割精度,推理延迟降67%
- 适合医院本地部署,兼顾准确率与运行效率
在医院本地环境中部署医学图像分割模型常受限于计算资源固定、无法使用云端推理。尽管高性能模型精度高,但计算开销大,难以长期维护。本文提出一种面向部署的框架,通过知识蒸馏将高精度教师模型转化为可扩展的小型学生模型,不改变原有推理流程。该方法保持与现有临床系统的架构兼容性,支持容量系统化缩减。在包含1,104个3D脑部MRI的多中心数据集上评估,独立测试101例,进一步在腹部CT上验证跨模态泛化能力。在参数减少94%的情况下,学生模型保留了98.7%的教师模型精度,同时实现最高67%的CPU推理延迟降低,且无额外部署开销。结果表明,知识蒸馏为将研究级分割模型转化为可维护、可部署的本地医疗系统组件提供了可靠路径。
原文摘要 · Abstract (English)
Deploying medical image segmentation models in routine clinical workflows is often constrained by on-premises infrastructure, where computational resources are fixed and cloud-based inference may be restricted by governance and security policies. While high-capacity models achieve strong segmentation accuracy, their computational demands hinder practical deployment and long-term maintainability in hospital environments. We present a deployment-oriented framework that leverages knowledge distillation to translate a high-performing segmentation model into a scalable family of compact student models, without modifying the inference pipeline. The proposed approach preserves architectural compatibility with existing clinical systems while enabling systematic capacity reduction. The framework is evaluated on a multi-site brain MRI dataset comprising 1,104 3D volumes, with independent testing on 101 curated cases, and is further examined on abdominal CT to assess cross-modality generalizability. Under aggressive parameter reduction (94%), the distilled student model preserves nearly all of the teacher's segmentation accuracy (98.7%), while achieving substantial efficiency gains, including up to a 67% reduction in CPU inference latency without additional deployment overhead. These results demonstrate that knowledge distillation provides a practical and reliable pathway for converting research-grade segmentation models into maintainable, deployment-ready components for on-premises clinical workflows in real-world health systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。