用AI+专家协作提升复杂领域共识制定效率与质量
The Human-AI Hybrid Delphi Model: A Structured Framework for Context-Rich, Expert Consensus in Complex Domains
- 融合AI生成与小规模专家小组,分三阶段优化共识流程
- AI复现95%专家结论,专家达成超90%共识且提前饱和
- 适合健康、训练等需条件化建议的高复杂度领域
在证据复杂、冲突或不足的领域,专家共识对决策至关重要。传统方法如德尔菲法虽具结构,但面临专家负担重、简化解读、忽视条件细节等问题,信息过载与碎片化证据进一步加剧挑战。本文提出人机混合德尔菲(HAH-Delphi)框架,整合生成式AI(Gemini 2.5 Pro)、少量资深专家及结构化引导。该框架在三个阶段验证:回顾性复制中AI复现95%已发表共识;前瞻性对比中与专家方向一致率达95%,但缺乏经验与实践细节;应用部署阶段,六人专家组实现>90%共识覆盖,并在最终参与者前达到主题饱和。AI提供持续、文献支撑的结构支持,促进分歧解决并加速共识形成。该框架具备灵活性与可扩展性,已在运动科学、健康与教练领域成功应用,证实其方法稳健性,可作为生成条件化、个性化指导与大规模共识框架的基础。
原文摘要 · Abstract (English)
Expert consensus plays a critical role in domains where evidence is complex, conflicting, or insufficient for direct prescription. Traditional methods, such as Delphi studies, consensus conferences, and systematic guideline synthesis, offer structure but face limitations including high panel burden, interpretive oversimplification, and suppression of conditional nuance. These challenges are now exacerbated by information overload, fragmentation of the evidence base, and increasing reliance on publicly available sources that lack expert filtering. This study introduces and evaluates a Human-AI Hybrid Delphi (HAH-Delphi) framework designed to augment expert consensus development by integrating a generative AI model (Gemini 2.5 Pro), small panels of senior human experts, and structured facilitation. The HAH-Delphi was tested in three phases: retrospective replication, prospective comparison, and applied deployment in two applied domains (endurance training and resistance and mixed cardio/strength training). The AI replicated 95% of published expert consensus conclusions in Phase I and showed 95% directional agreement with senior human experts in Phase II, though it lacked experiential and pragmatic nuance. In Phase III, compact panels of six senior experts achieved >90% consensus coverage and reached thematic saturation before the final participant. The AI provided consistent, literature-grounded scaffolding that supported divergence resolution and accelerated saturation. The HAH-Delphi framework offers a flexible, scalable approach for generating high-quality, context-sensitive consensus. Its successful application across health, coaching, and performance science confirms its methodological robustness and supports its use as a foundation for generating conditional, personalised guidance and published consensus frameworks at scale.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。