用自然语言指令解码风格表示,让模型更懂写作风格。
Interpreting Style Representations via Style-Eliciting Prompts

- 设计可引导大模型生成特定风格文本的提示词
- 1010个风格特征构建数据集,实现风格还原与模仿
- 适合需要解释或控制文本风格的研究与应用
风格表示学习在作者分析和写作风格建模中具有强大能力,但其隐式特性使解释困难。现有方法依赖大语言模型(LLM)生成自然语言描述,易受偏见和幻觉影响,且缺乏明确目标与实用价值。本文提出一种通过风格诱发提示(style-eliciting prompts)解释风格表示的新框架:即设计自然语言指令,引导LLM生成体现特定风格属性的文本。我们整理了1,010个跨26类风格维度的特征,并利用LLM生成对应文本构建数据集。基于该数据集,训练解码器从生成文本的风格表示中恢复出原始风格提示。在三个任务上评估:(1)从生成文本中恢复原始提示;(2)使用恢复提示复现相同风格文本;(3)使大模型输出匹配人类写作文本风格。实验表明,该方法显著优于直接以目标文本提示大模型的强基线,在风格描述与模仿任务中均表现更优。结果表明,风格诱发提示能为风格表示中的信息提供实用且可解释的接口。
原文摘要 · Abstract (English)
Style representation learning is a powerful tool for authorship analysis and modeling writing style, yet the latent nature of learned representations makes them difficult to interpret. Recent work has attempted to explain these representations by generating natural language descriptions with large language models (LLMs) conditioned on input text. However, such descriptions are often prone to the LLM's biases and hallucinations, and they lack an explicit objective and practical utility. In this work, we propose a novel framework for interpreting style representations through style-eliciting prompts: natural language instructions designed to steer LLMs to generate text that reflects specific stylistic attributes. We curate 1,010 distinct style features spanning 26 stylistic categories and construct a dataset by prompting an LLM to generate text conditioned on these features. Using this data, we train a decoder to generate a style prompt from the style representation of the generated text. We evaluate our approach on three tasks: (1) recovering original style prompts from generated text, (2) generating text in the same style using the recovered prompts, and (3) steering LLM outputs to match the style of human-written texts. Experiments demonstrate that our method consistently outperforms strong baselines that directly prompt LLMs with target text, achieving superior performance in both style description and style imitation. These results highlight that style-eliciting prompts can provide a practical and interpretable interface to stylistic information encoded in style representations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。