arXiv:2502.13349cs.CL2025-02被引 8

用大模型自动分析事件分割与记忆召回,效率远超人工。

Event Segmentation Applications in Large Language Model Enabled Automated Recall Assessments

  • 用LLM的聊天和文本嵌入功能自动识别事件边界
  • 大模型分割结果比人评更一致,且能预测记忆表现
  • 适合研究认知障碍、心理实验自动化评估

理解个体在自然环境中如何感知和回忆信息,对认识感知(如感官丧失)和记忆(如痴呆)缺陷至关重要。事件分割是识别动态环境中独立事件的过程,影响即时理解与特定事件记忆的形成。尽管其重要性突出,现有研究仍严重依赖人工判断来评估分割模式和回忆能力,存在主观性强、耗时等问题。少数自动化方法已出现,但有效性与可实施性仍有待提升。为此,我们利用大语言模型(LLMs)实现事件分割与回忆评分,分别采用聊天补全与文本嵌入模型。经验证,LLMs能准确识别事件边界,且人类的分割一致性高于人与人之间的一致性。基于此框架,我们提出一种自动化回忆评估方法,发现分段叙事事件与参与者回忆之间的语义相似度可有效预测回忆表现。研究证明LLMs可高效模拟人类分割模式,并提供可扩展的替代人工评分的回忆评估方案,为人工智能驱动的认知科学新研究路径开辟可能。

原文摘要 · Abstract (English)

Understanding how individuals perceive and recall information in their natural environments is critical to understanding potential failures in perception (e.g., sensory loss) and memory (e.g., dementia). Event segmentation, the process of identifying distinct events within dynamic environments, is central to how we perceive, encode, and recall experiences. This cognitive process not only influences moment-to-moment comprehension but also shapes event specific memory. Despite the importance of event segmentation and event memory, current research methodologies rely heavily on human judgements for assessing segmentation patterns and recall ability, which are subjective and time-consuming. A few approaches have been introduced to automate event segmentation and recall scoring, but validity with human responses and ease of implementation require further advancements. To address these concerns, we leverage Large Language Models (LLMs) to automate event segmentation and assess recall, employing chat completion and text-embedding models, respectively. We validated these models against human annotations and determined that LLMs can accurately identify event boundaries, and that human event segmentation is more consistent with LLMs than among humans themselves. Using this framework, we advanced an automated approach for recall assessments which revealed semantic similarity between segmented narrative events and participant recall can estimate recall performance. Our findings demonstrate that LLMs can effectively simulate human segmentation patterns and provide recall evaluations that are a scalable alternative to manual scoring. This research opens novel avenues for studying the intersection between perception, memory, and cognitive impairment using methodologies driven by artificial intelligence.

大模型事件分割记忆评估认知科学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。