用图像生成减轻研究者与参与者撰写叙事的负担
Visually Grounded Narratives: Reducing Cognitive Burden in Researcher-Participant Interaction
- 将研究文档自动转为连贯故事图,降低文本解读压力
- 仅需0.96%数据即达最优效果,FID得分降至152
- 适合需要高效叙事生成的研究人员和参与者
叙事探究是分析人类经验的重要领域,旨在理解社会的复杂性。然而,研究者需将各类数据手工整理成连贯的故事文本,带来巨大分析负担;参与者也需进行成员核对,审阅大量文档。为此,我们提出新范式NAME,首次实现研究文档到连贯故事图像的自动转换,显著减轻研究者与参与者的认知负担。通过设计演员位置与形状模块,提升图像生成合理性;构建包含感知质量与叙事一致性三个维度的评估指标体系。实验表明,本方法在不同数据划分下均达领先性能:当基线使用100%数据时,我们的方法仅需0.96%数据,即可将FID从195降至152;在70:30与95:5划分下,FID分别从175、96降至152、49;新指标得分达3.62,优于基线2.66。
原文摘要 · Abstract (English)
Narrative inquiry has been one of the prominent application domains for the analysis of human experience, aiming to know more about the complexity of human society. However, researchers are often required to transform various forms of data into coherent hand-drafted narratives in storied form throughout narrative analysis, which brings an immense burden of data analysis. Participants, too, are expected to engage in member checking and presentation of these narrative products, which involves reviewing and responding to large volumes of documents. Given the dual burden and the need for more efficient and participant-friendly approaches to narrative making and representation, we made a first attempt: (i) a new paradigm is proposed, NAME, as the initial attempt to push the field of narrative inquiry. Name is able to transfer research documents into coherent story images, alleviating the cognitive burden of interpreting extensive text-based materials during member checking for both researchers and participants. (ii) We develop an actor location and shape module to facilitate plausible image generation. (iii) We have designed a set of robust evaluation metrics comprising three key dimensions to objectively measure the perceptual quality and narrative consistency of generated characters. Our approach consistently demonstrates state-of-the-art performance across different data partitioning schemes. Remarkably, while the baseline relies on the full 100% of the available data, our method requires only 0.96% yet still reduces the FID score from 195 to 152. Under identical data volumes, our method delivers substantial improvements: for the 70:30 split, the FID score decreases from 175 to 152, and for the 95:5 split, it is nearly halved from 96 to 49. Furthermore, the proposed model achieves a score of 3.62 on the newly introduced metric, surpassing the baseline score of 2.66.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。