arXiv:2601.07988cs.CLcs.AI2026-01ACL被引 5

将文本分析从静态词序列转向动态行为序列,更真实地捕捉个体心理变化。

From Word Sequences to Behavioral Sequences: Adapting Modeling and Evaluation Paradigms for Longitudinal NLP

  • 用时间有序的个体行为序列替代独立文档,建模个体随时间的变化
  • 传统方法在238人1.7万条日记上得出错误结论,新方法更准确反映症状发展
  • 适合研究心理健康、个人轨迹等长期动态问题的研究者

自然语言处理通常将文档视为独立无序样本,但在纵向研究中,文档嵌套于作者且按时间顺序排列,构成以个体为索引、时间有序的‘行为序列’。本文提出纵向建模与评估范式,更新了NLP流程的四个环节:(1)评估划分对应跨人群(跨截面)和跨时间(前瞻性)泛化;(2)准确率指标区分个体间差异与个体内动态;(3)输入默认包含历史信息;(4)模型内部支持对历史状态的不同抽象粒度(聚合摘要、显式动态或交互模型)。我们在包含238名参与者、1.7万条每日日记及创伤后应激障碍症状严重程度的数据集上验证,传统文档级评估可能导致截然不同甚至相反的结论,而新范式更具生态效度。结果推动从词序列评估向行为序列范式的转变。

原文摘要 · Abstract (English)

While NLP typically treats documents as independent and unordered samples, in longitudinal studies, this assumption rarely holds: documents are nested within authors and ordered in time, forming person-indexed, time-ordered $\textit{behavioral sequences}$. Here, we demonstrate the need for and propose a longitudinal modeling and evaluation paradigm that consequently updates four parts of the NLP pipeline: (1) evaluation splits aligned to generalization over people ($\textit{cross-sectional}$) and/or time ($\textit{prospective}$); (2) accuracy metrics separating between-person differences from within-person dynamics; (3) sequence inputs to incorporate history by default; and (4) model internals that support different $\textit{coarseness}$ of latent state over histories (pooled summaries, explicit dynamics, or interaction-based models). We demonstrate the issues ensued by traditional pipeline and our proposed improvements on a dataset of 17k daily diary transcripts paired with PTSD symptom severity from 238 participants, finding that traditional document-level evaluation can yield substantially different and sometimes reversed conclusions compared to our ecologically valid modeling and evaluation. We tie our results to a broader discussion motivating a shift from word-sequence evaluation toward $\textit{behavior-sequence}$ paradigms for NLP.

纵向分析行为序列心理健康动态建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。