构建六维分类体系,系统梳理模型训后调整技术。
A Six-Dimensional Taxonomy of Post-Training Adaptation Techniques with Applications in AI Governance
- 提出机制、目标、数据需求等六个维度的分类框架
- 厘清微调、检索增强等易混淆概念的差异
- 助力模型治理与技术追踪,适合政策制定者和开发者
训后调整已成为现代机器学习的核心实践,涵盖重训练、微调、参数高效调整、对齐、检索增强、模型编辑、遗忘、校准及多模态指令微调等技术。然而,现有文献在技术族类、模型类型与部署场景间碎片化严重,难以比较方法或描述模型修改过程。本文综述训后调整研究,提出一个由机制、目标、数据需求、持久性、结构范围和模型类型构成的六维分类体系。该框架区分了常被混淆的术语如微调、检索增强与提示工程,并揭示从传统机器学习到深度学习、基础模型、大语言模型及多模态大语言模型的适应策略演进路径。同时,映射出技术间的继承、替代、融合与分层部署关系。该分类体系可支持技术文档撰写、模型变更追踪与治理分析。最后,指出评估、可复现性、持续推理时调整、遗忘、多模态适配及治理感知的训后工作流等开放挑战。
原文摘要 · Abstract (English)
Post-training adaptation has become central to modern machine learning practice and includes techniques such as retraining, fine-tuning, parameter-efficient adaptation, alignment, retrieval augmentation, model editing, unlearning, calibration, and Multimodal Instruction Tuning. However, the literature remains fragmented across technique families, model classes, and deployment contexts, making it difficult to compare methods or describe how a trained model has been modified. This survey synthesizes the post-training adaptation literature and introduces a six-dimensional taxonomy organized by mechanism, goal, data requirement, persistence, structural scope, and model type. The taxonomy distinguishes commonly conflated terms such as fine-tuning, retrieval augmentation, and prompting, and shows how adaptation strategies evolve from traditional machine learning through deep learning, foundation models, large language models, and multimodal large language models. It also maps relationships among techniques, including inheritance, supersession, hybridization, and layered deployment stacks. The resulting vocabulary can support technical documentation, model-change tracking, and governance analysis. The survey concludes by identifying open challenges in evaluation, reproducibility, persistent inference-time adaptation, unlearning, multimodal adaptation, and governance-aware post-training workflows.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。