用树状结构生成创意评估用情境,提升质量与多样性。
AlphaContext: An Evolutionary Tree-based Psychometric Context Generator for Creativity Assessment

- 构建树形框架+强化学习填充,保证结构完整与细节质量。
- 通过进化优化使生成情境在6项指标上平均提升8%。
- 适合需要科学评估创意能力的研究者或教育机构使用。
创造力已成为大语言模型时代人机协作中的核心能力,支撑现实问题解决的创新。系统性提升创造力需依赖科学有效的评估工具。心理测量学认为基于情境的评估是衡量创造性思维的有效方式,但高质量专家设计的情境仍稀缺。现有基于大语言模型的生成器常存在评估线索不足、叙事连贯性弱、风格多样性有限及对创造性思维支持不足等问题。为此,我们提出 AlphaContext,一种基于演化树的心理测量情境生成器。首先,超树大纲规划器将专家设计的大纲形式化为规则引导的超树,并进行自顶向下的层次规划;其次,基于蒙特卡洛树搜索(MCTS)的情境生成器在大纲基础上填充内容,平衡全局结构与局部质量;随后,演化情境优化器利用 MAP-Elites 方法不断更新细分领域精英,协同提升情境的多样性和质量;最后,评估引导的演化精炼器模拟具有不同风格的虚拟参与者,回收低质情境进行进一步演化。实验表明,AlphaContext 在6项质量指标上平均优于竞争方法8%。
原文摘要 · Abstract (English)
Creativity has become a core competence in the era of LLMs and human-AI collaboration, underpinning innovation in real-world problem solving. Crucially, the systematic improvement of creativity necessitates scientifically valid assessment instruments. Psychometric research recognizes context-based assessment as an effective way to measure creative thinking. However, high-quality expert-designed contexts remain scarce. Existing LLM-based generators often struggle with insufficient assessment cues, weak narrative coherence, limited stylistic diversity, and poor support for creative thinking. To address these challenges, we propose AlphaContext, an evolutionary tree-based psychometric context generator for creativity assessment. First, the HyperTree Outline Planner formalizes expert-designed outlining as a rule-guided hypertree and performs top-down hierarchical planning. The MCTS-based Context Generator fills the outline via MCTS to balance global structure and local quality. Then, the Evolutionary Context Optimizer evolves contexts with MAP-Elites by repeatedly updating niche elites to jointly improve diversity and quality. Finally, the Assessment-Guided Evolution Refiner simulates virtual participants with diverse styles and recycles weak contexts for further evolution. Experiments show that AlphaContext yields an average improvement of 8% over competitive methods across 6 quality metrics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。