arXiv:2511.05841cs.CVcs.AI2025-11

用视觉语言模型分析手写笔迹,提升阿尔茨海默病早期筛查准确率

Understanding Cross Task Generalization in Handwriting-Based Alzheimer's Screening via Vision Language Adaptation

  • 基于CLIP改造轻量级融合适配器,实现无需提示的零样本推理
  • 发现特定书写任务和笔画模式对阿尔茨海默病判别效果最佳
  • 为手写认知评估提供可复现的基准与诊断新思路

阿尔茨海默病是一种常见神经退行性疾病,早期检测至关重要。手写——在前驱期常出现异常——提供了无创且低成本的微小运动与认知衰退窗口。现有手写类阿尔茨海默病研究多依赖在线轨迹和手工特征,未系统考察任务类型对诊断性能及跨任务泛化的影响。与此同时,大规模视觉语言模型在自然图像异常检测中表现卓越,且在胸片、脑MRI等医学模态中展现出强适应性。然而,手写疾病检测仍鲜见于此范式。为此,我们提出轻量级跨层融合适配器框架(CLFA),将CLIP改造用于手写阿尔茨海默病筛查。CLFA在视觉编码器中嵌入多层级融合适配器,逐步对齐表示以捕捉手写特异性医学线索,支持免提示、高效的零样本推理。利用该框架,我们系统研究了跨任务泛化——在特定书写任务上训练,评估未见过的任务——揭示哪些任务类型与书写模式最能区分阿尔茨海默病。大量分析进一步指出特征笔画模式与任务级因素对手写认知评估的关键作用,为早期识别提供诊断洞见并建立基准。

原文摘要 · Abstract (English)

Alzheimer's disease is a prevalent neurodegenerative disorder for which early detection is critical. Handwriting-often disrupted in prodromal AD-provides a non-invasive and cost-effective window into subtle motor and cognitive decline. Existing handwriting-based AD studies, mostly relying on online trajectories and hand-crafted features, have not systematically examined how task type influences diagnostic performance and cross-task generalization. Meanwhile, large-scale vision language models have demonstrated remarkable zero or few-shot anomaly detection in natural images and strong adaptability across medical modalities such as chest X-ray and brain MRI. However, handwriting-based disease detection remains largely unexplored within this paradigm. To close this gap, we introduce a lightweight Cross-Layer Fusion Adapter framework that repurposes CLIP for handwriting-based AD screening. CLFA implants multi-level fusion adapters within the visual encoder to progressively align representations toward handwriting-specific medical cues, enabling prompt-free and efficient zero-shot inference. Using this framework, we systematically investigate cross-task generalization-training on a specific handwriting task and evaluating on unseen ones-to reveal which task types and writing patterns most effectively discriminate AD. Extensive analyses further highlight characteristic stroke patterns and task-level factors that contribute to early AD identification, offering both diagnostic insights and a benchmark for handwriting-based cognitive assessment.

阿尔茨海默病手写分析视觉语言模型零样本学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。