让两个导演风格在模型中碰撞,发现乐观风格主导叙事走向
Creative Collision: Directorial Persona Steering and Competition in Large Language Models

- 用两位导演的台词数据构造对立风格向量,通过混合参数控制风格融合
- 中间混合点反而提升生成连贯性,且斯皮尔伯格风格始终占据主导地位
- 两风格都在模型第28层最显著,揭示道德基调的共享神经基础
激活操控已成为推理时调控大语言模型行为的强大工具,但以往工作多仅注入单一语义方向。本文研究两种语义对立方向叠加的更丰富场景,称为‘创意碰撞’。我们基于精选剧本语料,通过均值差异激活对比,构建史蒂文·斯皮尔伯格(乐观、救赎式道德观)与马丁·斯科塞斯(黑暗、道德模糊)的导演人格向量,再以标量混合参数α∈[0,1]和操控系数λ进行插值。在五个评估维度——道德取向、生成连贯性、表层风格、方向主导性及向量几何——上发现三个核心结果:(i) 斯皮尔伯格的表征特征表现出强方向主导性,在几乎整个插值范围内压制了斯科塞斯的道德影响;(ii) 中间碰撞点在高λ下反而比单一导演操控更优地提升生成连贯性;(iii) 两者人格向量均在40层解码器变压器的第28层达到最大局部化,揭示共享的‘道德基调底座’。这些发现揭示了变压器残差流中竞争语义方向的几何特性,对可控创意生成与价值对齐的叙事合成具有直接意义。
原文摘要 · Abstract (English)
Activation steering has emerged as a powerful tool for shaping the behaviour of large language models at inference time, yet most prior work injects a \emph{single} semantic direction into the residual stream. We study the richer setting in which two semantically opposing steering vectors are superimposed -- a regime we call \textbf{Creative Collision}. Concretely, we construct directorial persona vectors for Steven Spielberg (optimistic, redemptive moral valence) and Martin Scorsese (dark, morally ambiguous) via mean-difference activation contrast on curated screenplay-derived corpora, then interpolate between them with a scalar mixing parameter $α\in [0,1]$ and a steering coefficient $λ$. Across five evaluation axes -- moral valence, generation coherence, surface style, directional dominance, and vector geometry -- three principal findings emerge: (i)~Spielberg's representational signature exhibits robust \emph{directional dominance}, suppressing Scorsese's moral influence across almost the entire interpolation range; (ii)~intermediate collision points paradoxically \emph{improve} generation coherence relative to pure single-director steering at high $λ$; and (iii)~both personas localise maximally to layer~28 of a 40-layer decoder-only transformer, revealing a shared \emph{moral-tone substrate}. These results illuminate the geometry of competing semantic directions in transformer residual streams and have direct implications for controllable creative generation and value-aligned narrative synthesis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。