无需用户反馈,用模拟评委自动生成个性化故事
PREFINE: Personalized Story Generation via Simulated User Critics and User-Specific Rubric Generation
- 通过用户历史构建虚拟评委,生成专属评价标准
- 在两个数据集上显著提升个性化程度,同时保持故事质量
- 适合需要隐私保护的场景,如对话与教育应用
个性化故事生成仍是自然语言生成的核心挑战。现有方法通常依赖显式用户反馈或参数微调,存在可用性、可扩展性和隐私问题。本文提出PREFINE(基于人格与评分标准的批判与优化框架),一种无需用户反馈或参数更新的个性化故事生成方法。PREFINE从用户交互历史构建伪用户代理,并生成用户特定的评分标准(评价准则),用于批判和迭代优化故事草稿以匹配用户偏好。我们在PerDOC和PerMPST两个基准数据集上评估PREFINE,自动与人工评估均显示其显著提升个性化效果,同时保持通用故事质量。值得注意的是,PREFINE优于现有的上下文个性化与基于批判的生成方法,甚至能对已有个性化输出进行后处理优化。分析表明,用户特定评分标准是实现个性化的关键。结果证明了仅推理、基于评分标准引导的个性化方法的有效性与实用性,其应用潜力可扩展至对话、推荐与教育等领域。
原文摘要 · Abstract (English)
Personalizing story generation to individual users remains a core challenge in natural language generation. Existing approaches typically require explicit user feedback or fine-tuning, which pose practical concerns in terms of usability, scalability, and privacy. In this work, we introduce PREFINE (Persona-and-Rubric Guided Critique-and-Refine), a novel Critique-and-Refine framework that enables personalized story generation without user feedback or parameter updates. PREFINE constructs a pseudo-user agent from a user's interaction history and generates user-specific rubrics (evaluation criteria). These components are used to critique and iteratively refine story drafts toward the user's preferences. We evaluate PREFINE on two benchmark datasets, PerDOC and PerMPST, and compare it with existing approaches. Both automatic and human evaluations show that PREFINE achieves significantly better personalization while preserving general story quality. Notably, PREFINE outperforms existing in-context personalization and critique-based generation methods, and can even enhance already personalized outputs through post-hoc refinement. Our analysis reveals that user-specific rubrics are critical in driving personalization. The results demonstrate the effectiveness and practicality of inference-only, rubric-guided personalization, with potential applications beyond storytelling, including dialogue, recommendation, and education.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。