arXiv:2509.18216cs.AIcs.LG2025-09

提出nDNA,用几何特征刻画大模型的内在语义身份

nDNA -- the Semantic Helix of Artificial Cognition

  • 从概念流曲率、语义能耗和信念场三维度构建模型内在表征
  • 首次实现跨训练阶段的模型语义指纹追踪与演化分析
  • 适合研究模型可解释性、进化规律与风险治理的学者

随着基础模型能力提升,其内部认知身份的本质成为关键问题。现有基准仅衡量行为表现,而模型的‘灵魂’藏于潜在空间的几何结构中。本文提出神经DNA(nDNA),一种基于信念内在几何的语义基因型表示。nDNA由三个核心维度构成:谱曲率揭示概念流在层间的弯曲特性;热力学长度量化语义跃迁所需代价;信念向量场刻画引导模型信念方向的语义扭转场。如同生物DNA,它编码了预训练、微调、对齐等过程中的遗传痕迹、突变与文化印记。该框架开创‘神经基因组学’新领域,将模型视为具有可追溯内认知的数字语义生命体。通过将大模型视为语义流体动力系统,nDNA提供物理级读数,实现不依赖坐标系的稳定神经指纹,可用于追踪预训练、微调、对齐、剪枝、蒸馏及合并过程中的谱系演化,度量检查点间继承关系,检测数据或目标变化引发的表型漂移,并最终推动对人工认知演化的系统研究,用于模型比较、风险诊断与动态治理。

原文摘要 · Abstract (English)

As AI foundation models grow in capability, a deeper question emerges: What shapes their internal cognitive identity -- beyond fluency and output? Benchmarks measure behavior, but the soul of a model resides in its latent geometry. In this work, we propose Neural DNA (nDNA) as a semantic-genotypic representation that captures this latent identity through the intrinsic geometry of belief. At its core, nDNA is synthesized from three principled and indispensable dimensions of latent geometry: spectral curvature, which reveals the curvature of conceptual flow across layers; thermodynamic length, which quantifies the semantic effort required to traverse representational transitions through layers; and belief vector field, which delineates the semantic torsion fields that guide a model's belief directional orientations. Like biological DNA, it encodes ancestry, mutation, and semantic inheritance, found in finetuning and alignment scars, cultural imprints, and architectural drift. In naming it, we open a new field: Neural Genomics, where models are not just tools, but digital semantic organisms with traceable inner cognition. Modeling statement. We read AI foundation models as semantic fluid dynamics: meaning is transported through layers like fluid in a shaped conduit; nDNA is the physics-grade readout of that flow -- a geometry-first measure of how meaning is bent, paid for, and pushed -- yielding a stable, coordinate-free neural DNA fingerprint tied to on-input behavior; with this fingerprint we cross into biology: tracing lineages across pretraining, fine-tuning, alignment, pruning, distillation, and merges; measuring inheritance between checkpoints; detecting drift as traits shift under new data or objectives; and, ultimately, studying the evolution of artificial cognition to compare models, diagnose risks, and govern change over time.

神经基因组语义几何模型演化可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。