用帕累托优化平衡公平性与个性化,提升文本生成的公正性。
Pareto-Guided Teacher Alignment for Fair Personalized Text Generation

- 基于帕累托框架的教师对齐,分步优化公平与个性。
- 在气候变化和疫苗劝说任务中,公平性与个性化无法兼顾。
- 适合关注生成公平性的自然语言生成研究者使用。
个性化说服性文本生成可提升相关性与参与度,但基于人口统计的条件可能引入群体间不平等的表述。本文将公平性缓解视为受限的多目标对齐问题:在降低人口差异的同时保持个性化保真度。提出一种帕累托引导的教师对齐框架,包含基于修正的候选生成、成对可行性门控、帕累托风格候选选择,并可通过监督微调与直接偏好优化实现可选偏好优化。在气候变迁与疫苗接种劝说任务上评估,使用包含性别与年龄匹配对的控制型上下文丰富人口网格,以及涵盖说服偏倚、正式程度差异、情感框架差异、词汇关联差异和个性化保真度的统一五项审计评估套件。跨两个领域及跨模型家族迁移设置下,单一对齐策略无法同时最优满足所有目标;不同方法占据公平性-个性化帕累托前沿的不同区域:部分强化减少差异,部分更好保留个性化或人口稳定性。结果表明,公平性缓解效果依赖具体目标,且在不同领域与模型族间转移不一致,支持在敏感场景下采用边界回归与多审计模型选择,而非单指标优化。
原文摘要 · Abstract (English)
Personalized persuasive text generation can improve relevance and engagement, but demographic conditioning may also introduce unequal framing across groups. We study fairness mitigation in personalized generation as a constrained multi-objective alignment problem: reduce demographic disparities while preserving personalization fidelity. We propose a Pareto-guided teacher alignment framework that combines revision-based candidate generation, pair-aware feasibility gating, Pareto-style candidate selection, and optional preference optimization through supervised fine-tuning and direct preference optimization. We evaluate the framework on climate change and vaccination persuasion tasks using a controlled context-rich demographic grid with matched gender and age pairs and a unified five-audit evaluation suite spanning persuasion bias, formality disparity, emotional framing disparity, lexical association disparity, and personalization fidelity. Across both domains and cross-family transfer settings, no single alignment strategy dominates all objectives simultaneously. Instead, methods occupy different regions of a fairness-personalization Pareto frontier: some achieve stronger disparity reductions, while others better preserve personalization or demographic stability. Our results show that fairness mitigation effects are objective-dependent and transfer inconsistently across domains and model families, motivating bounded-regression, multi-audit model selection over single-metric optimization for fairness-sensitive personalized generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。