让AI根据场景自动选择情绪表达方式,生成更自然的文本。
MOPO: Multi-Objective Prompt Optimization for Affective Text Generation
- 通过多目标优化,同时适配不同领域的情绪表达风格
- 在多个情绪分类任务上提升15个百分点,单个任务仅损失1-2个百分点
- 用户可自由选择最合适的表达风格,适合跨场景情感生成
情绪的表达方式取决于语境和领域。例如,在X(原推特)上,作者可能直接使用#anger标签,而在新闻标题中,情绪通常以更礼貌、间接的方式呈现。为使条件文本生成模型能生成符合特定领域的有情绪色彩文本,用户需要一个可调节参数来选择合适的情绪表达方式。为此,我们提出MOPO——一种多目标提示优化方法。MOPO根据多个目标(对应于针对不同领域训练的情绪分类器输出的概率)优化提示。与单目标优化不同,MOPO输出一组具有不同目标权重的提示,用户可根据上下文选择最合适的提示。我们在三个由不同领域情绪分类器定义的目标上评估MOPO,结果表明其在所有目标上性能最高提升15个百分点,相比单目标优化,任一目标性能仅下降1-2个百分点。这种微小损失换来的是对多个目标更广泛的泛化能力,这是单目标优化无法实现的。此外,MOPO通过同时优化多个目标,减少了计算开销,避免了对每个目标单独进行优化的冗余流程。
原文摘要 · Abstract (English)
How emotions are expressed depends on the context and domain. On X (formerly Twitter), for instance, an author might simply use the hashtag #anger, while in a news headline, emotions are typically written in a more polite, indirect manner. To enable conditional text generation models to create emotionally connotated texts that fit a domain, users need to have access to a parameter that allows them to choose the appropriate way to express an emotion. To achieve this, we introduce MOPO, a Multi-Objective Prompt Optimization methodology. MOPO optimizes prompts according to multiple objectives (which correspond here to the output probabilities assigned by emotion classifiers trained for different domains). In contrast to single objective optimization, MOPO outputs a set of prompts, each with a different weighting of the multiple objectives. Users can then choose the most appropriate prompt for their context. We evaluate MOPO using three objectives, determined by various domain-specific emotion classifiers. MOPO improves performance by up to 15 pp across all objectives with a minimal loss (1-2 pp) for any single objective compared to single-objective optimization. These minor performance losses are offset by a broader generalization across multiple objectives - which is not possible with single-objective optimization. Additionally, MOPO reduces computational requirements by simultaneously optimizing for multiple objectives, eliminating separate optimization procedures for each objective.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。