用故事化布局生成科学教育图像,提升理解力。
LEARN: A Story-Driven Layout-to-Image Generation Framework for STEM Instruction
- 基于叙事布局生成图像,确保概念连贯
- 生成内容符合布鲁姆认知层次,降低认知负荷
- 适合教育AI、智能课件开发者使用
LEARN 是一种面向科学教育的布局感知扩散框架,旨在生成具有教学意义的插图。它利用自建的 BookCover 数据集,提供叙事性布局与结构化视觉线索,使模型能准确呈现抽象且具有时序性的科学概念,实现强语义对齐。通过布局条件生成、对比式图文训练及提示调制,LEARN 生成的视觉序列支持中高阶认知推理,符合布鲁姆分类法,并遵循认知负荷理论以减少额外认知负担。该框架通过空间有序的故事化叙述,对抗短平快媒体带来的注意力碎片化,促进持续概念聚焦。除静态图外,还可集成多模态系统与课程知识图谱,构建可适应、可探索的教育内容。作为首个融合布局叙事、语义结构学习与认知支架的生成方法,LEARN 开启了生成式 AI 在教育中的新方向。代码与数据集将公开,推动后续研究与应用。
原文摘要 · Abstract (English)
LEARN is a layout-aware diffusion framework designed to generate pedagogically aligned illustrations for STEM education. It leverages a curated BookCover dataset that provides narrative layouts and structured visual cues, enabling the model to depict abstract and sequential scientific concepts with strong semantic alignment. Through layout-conditioned generation, contrastive visual-semantic training, and prompt modulation, LEARN produces coherent visual sequences that support mid-to-high-level reasoning in line with Bloom's taxonomy while reducing extraneous cognitive load as emphasized by Cognitive Load Theory. By fostering spatially organized and story-driven narratives, the framework counters fragmented attention often induced by short-form media and promotes sustained conceptual focus. Beyond static diagrams, LEARN demonstrates potential for integration with multimodal systems and curriculum-linked knowledge graphs to create adaptive, exploratory educational content. As the first generative approach to unify layout-based storytelling, semantic structure learning, and cognitive scaffolding, LEARN represents a novel direction for generative AI in education. The code and dataset will be released to facilitate future research and practical deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。