arXiv:2508.15841cs.CLcs.LG2025-08综述被引 2

研究大模型训练过程中的能力发展规律,为AI安全提供新视角。

A Review of Developmental Interpretability in Large Language Models

  • 从静态分析转向动态追踪模型训练全过程。
  • 发现知识获取呈双阶段模式,能力随训练出现相变式涌现。
  • 类比人类认知发展,助力理解模型学习机制,适合安全与可解释性研究者。

本文综述了大语言模型(LLM)发展中可解释性的新兴领域。该领域从对训练完成模型的静态、事后分析,演变为对训练过程本身的动态探究。文章首先回顾了表征探测、因果追踪和电路分析等基础方法,以解构模型学习过程。核心部分探讨了LLM能力发展的轨迹,包括计算电路的形成与构成、知识获取的双相特征、上下文学习策略的瞬时动态,以及作为训练相变现象的涌现能力。文中还探讨了与人类认知和语言发展的类比,为理解模型学习提供了重要概念框架。最后指出,这一发展视角不仅是学术探索,更是主动AI安全的基石,可实现对模型能力获取过程的预测、监控与对齐。文章总结了当前面临的重大挑战,如可扩展性和自动化,并提出构建更透明、可靠和有益人工智能系统的科研路线图。

原文摘要 · Abstract (English)

This review synthesizes the nascent but critical field of developmental interpretability for Large Language Models. We chart the field's evolution from static, post-hoc analysis of trained models to a dynamic investigation of the training process itself. We begin by surveying the foundational methodologies, including representational probing, causal tracing, and circuit analysis, that enable researchers to deconstruct the learning process. The core of this review examines the developmental arc of LLM capabilities, detailing key findings on the formation and composition of computational circuits, the biphasic nature of knowledge acquisition, the transient dynamics of learning strategies like in-context learning, and the phenomenon of emergent abilities as phase transitions in training. We explore illuminating parallels with human cognitive and linguistic development, which provide valuable conceptual frameworks for understanding LLM learning. Finally, we argue that this developmental perspective is not merely an academic exercise but a cornerstone of proactive AI safety, offering a pathway to predict, monitor, and align the processes by which models acquire their capabilities. We conclude by outlining the grand challenges facing the field, such as scalability and automation, and propose a research agenda for building more transparent, reliable, and beneficial AI systems.

可解释性大模型发展规律AI安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。