通过历史宇宙观实验,揭示模型适配如何改变解释框架而非直接改变认知立场。
Domain Adaptation and Reasoning Frameworks in Language Models: A Controlled Experiment with Historical Cosmology
- 用前哥白尼文本训练小模型,研究其是否自发产生地动论述
- 微调大模型后,解释框架转向古代模式,但宇宙观立场变化较小
- 适配主要影响表达方式,认知立场是间接结果,适合关注模型推理机制的研究者
我们以历史宇宙观为受控场景,研究领域适配如何重塑语言模型的解释行为。第一阶段,从头训练小型模型于去除日心引用的前哥白尼语料,评估是否仍会生成地球运动延续;第二阶段,使用QLoRA对大型预训练模型在相同语料上微调,探究适配对解释框架与宇宙观立场的影响。采用大模型作为评判者,标注宇宙观立场(地心、日心或模糊)及解释框架(前现代或现代)。在第一阶段,小模型偶尔生成局部地动延续,但全局不稳定且不足以支撑连贯宇宙论推理。第二阶段,微调导致解释框架显著向古代模式转移,而条件化宇宙观分布在此框架内相对稳定。地心输出增加主要源于解释范式重分配,而非立场直接改变。结果表明,领域适配更可能重塑生成延续的语言框架,立场变化为次级结果。
原文摘要 · Abstract (English)
We investigate how domain adaptation reshapes explanatory behavior in language models using historical cosmology as a controlled setting. In Phase 1, we train a small language model from scratch on a pre-Copernican corpus from which explicit heliocentric references were removed, and evaluate whether Earth-motion or heliocentric continuations nevertheless emerge. In Phase 2, we fine-tune a larger pretrained model using QLoRA on the same corpus in order to study how adaptation modifies explanatory framing and cosmological stance. Model outputs are evaluated using an LLM-as-judge framework that labels both cosmological stance (geocentric, heliocentric, or ambiguous) and explanatory frame (premodern versus modern). In the constrained setting of Phase 1, the smaller models occasionally generate local Earth-motion continuations, but these remain globally unstable and insufficient to support coherent cosmological reasoning. In Phase 2, fine-tuning induces a large and statistically significant shift toward premodern explanatory framing, while the conditional cosmological stance distributions remain comparatively stable within those frames. As a result, increases in geocentric outputs arise primarily from redistribution over explanatory regimes rather than from direct modification of stance. These results suggest that domain adaptation may primarily reshape the linguistic frameworks from which continuations are generated, with changes in stance emerging secondarily from those shifts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。