arXiv:2506.07695cs.SEcs.LG2025-06被引 1

为小型语言模型构建全生命周期框架,打通研究与应用断层。

Towards a Small Language Model Lifecycle Framework

  • 从36篇文献中提炼出模块化生命周期模型
  • 涵盖主流程、可选阶段与跨阶段组件,支持方法复用
  • 适合模型开发者、工具构建者及研究者参考

背景:对高效可部署语言模型的需求推动了小型语言模型(SLMs)的发展。然而现有研究分散,缺乏统一的生命周期视角。目标:通过整合学术与实践资源,定义小语言模型的完整生命周期框架。方法:系统调研36项相关工作,分析并分类生命周期相关技术。结果:提出一个由主干、可选和跨阶段组件构成的模块化模型,捕捉各阶段间关键关联,支持方法复用、协同适应与生命周期感知。结论:该框架为小语言模型的开发与维护提供连贯基础,弥合理论与实践差距,指导未来研究与工具设计。

原文摘要 · Abstract (English)

Background: The growing demand for efficient and deployable language models has led to increased interest in Small Language Models (SLMs). However, existing research remains fragmented, lacking a unified lifecycle perspective. Objective: This study aims to define a comprehensive lifecycle framework for SLMs by synthesizing insights from academic literature and practitioner sources. Method: We conducted a comprehensive survey of 36 works, analyzing and categorizing lifecycle-relevant techniques. Results: We propose a modular lifecycle model structured into main, optional, and cross-cutting components. The model captures key interconnections across stages, supporting method reuse, co-adaptation, and lifecycle-awareness. Conclusion: Our framework provides a coherent foundation for developing and maintaining SLMs, bridging theory and practice, and guiding future research and tool development.

小模型生命周期框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。