用对话策略优化激发并评估人机交互中的创造力。
IntElicit: Eliciting and Assessing Contextualized Creativity via Dialogue Policy Optimization

- 设计自适应AI面试官,通过对话引导激发创意。
- 实验显示其比人工设计基准更能激发创造性产出。
- 适合教育场景中评估人机协作下的真实创造力。
情境化评估能更真实反映创造力表现,但易受认知能力(领域知识)和主动性(参与意愿)干扰。在生成式AI时代,创造性问题解决多发生在人机交互环境中,静态评估已不匹配现实。本文提出IntElicit框架,通过对话策略优化实现情境化创造力的激发与评估。IntElicit作为受限自适应AI面试官,在多轮对话中提供非指令性知识与主动性支持,降低非创造性干扰因素,同时保持参与者对创意内容生成的责任。针对开放式教育对话中的奖励稀疏与奖励操纵(如答案诱导)问题,引入分解式过程奖励机制,奖励能引导参与者推理的提问,而非代为生成最优答案。大规模实验包括模拟用户与真人实验(N=64),结果表明IntElicit显著优于专家设计基线,揭示了静态评估可能遗漏的创造潜能,为人工智能辅助学习环境中的情境化创造力评估提供了形成性与诊断性视角。
原文摘要 · Abstract (English)
Contextualized assessment offers high ecological validity for evaluating creativity but introduces a critical challenge: observed performance may be confounded with cognitive proficiency (domain knowledge) and agency (willingness to engage). Meanwhile, in the age of generative AI, creative problem solving increasingly occurs in tool-mediated and human--AI interactive environments, making fully static assessment less aligned with contemporary creative practice. To address these issues, this paper proposes IntElicit, a framework for eliciting and assessing contextualized creativity via dialogue policy optimization. IntElicit functions as a constrained adaptive AI Interviewer: it provides non-directive knowledge and agency scaffolds in multi-turn interaction to reduce non-creative confounders, while preserving participants' responsibility for generating the creative content being evaluated. Specifically, to tackle sparse rewards and potential reward hacking (e.g., answer dictation) in open-ended educational dialogue, IntElicit introduces a decomposed process reward mechanism. This mechanism aligns the policy with pedagogical elicitation, rewarding prompts that draw out participant reasoning rather than producing optimal answers on their behalf. Extensive experiments, including participant simulation and a human subject study (N=64), show that IntElicit improves elicited creative outcomes over expert-designed baselines. Together, the results suggest that interactive elicitation can reveal creative potential that static FPSP-style assessment may miss, providing a formative and diagnostic lens for contextualized creativity assessment in AI-mediated learning contexts.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。